Jul 28 17:08:34.403145 ip-10-0-134-178 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 17:08:34.403154 ip-10-0-134-178 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 17:08:34.403161 ip-10-0-134-178 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 17:08:34.403427 ip-10-0-134-178 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 17:08:44.485631 ip-10-0-134-178 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 17:08:44.485651 ip-10-0-134-178 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 96ed49ec69ba4c14bfe7bc1280c3cb4b -- Jul 28 17:10:38.499104 ip-10-0-134-178 systemd[1]: Starting Kubernetes Kubelet... Jul 28 17:10:38.937292 ip-10-0-134-178 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:10:38.937292 ip-10-0-134-178 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 17:10:38.937292 ip-10-0-134-178 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:10:38.937292 ip-10-0-134-178 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 17:10:38.937292 ip-10-0-134-178 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:10:38.940173 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.940023 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 17:10:38.944776 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944762 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:10:38.944776 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944777 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944780 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944784 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944787 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944790 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944794 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944796 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944810 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944813 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944817 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944822 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944825 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944833 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944836 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944838 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944841 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944843 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944848 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944851 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:10:38.944848 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944855 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944858 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944861 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944864 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944867 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944870 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944873 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944876 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944879 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944882 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944885 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944888 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944892 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944894 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944897 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944899 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944902 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944904 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944907 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944909 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:10:38.945289 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944912 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944914 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944917 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944920 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944922 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944925 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944927 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944930 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944932 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944935 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944937 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944939 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944942 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944944 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944948 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944951 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944953 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944956 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944958 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944961 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:10:38.945761 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944964 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944966 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944969 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944971 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944974 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944977 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944981 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944983 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944986 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944989 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944992 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944994 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944997 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.944999 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945002 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945004 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945007 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945009 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945012 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945014 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:10:38.946243 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945017 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945019 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945022 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945024 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945027 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945029 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945032 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945035 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945037 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945040 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945042 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945045 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945047 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945050 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945052 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945055 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945057 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945060 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945063 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:10:38.946714 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945818 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945829 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945834 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945840 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945845 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945848 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945851 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945854 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945857 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945860 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945863 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945865 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945868 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945871 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945873 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945876 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945878 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945881 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945883 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:10:38.947187 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945886 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945889 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945891 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945894 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945896 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945899 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945901 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945904 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945906 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945909 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945911 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945913 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945916 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945918 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945921 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945923 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945926 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945929 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945931 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945934 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:10:38.947647 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945937 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945939 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945941 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945944 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945947 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945950 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945953 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945956 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945958 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945962 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945965 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945967 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945971 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945974 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945976 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945979 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945981 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945984 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945986 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945989 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:10:38.948146 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945991 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945994 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945996 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.945998 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946001 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946003 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946006 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946008 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946010 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946013 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946016 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946018 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946021 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946023 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946026 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946028 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946031 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946034 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946036 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946039 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:10:38.948640 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946041 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946044 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946046 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946049 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946051 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946054 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946056 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946059 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946062 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946064 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946066 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946070 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946072 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946075 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946078 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946080 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946083 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946085 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946088 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:10:38.949114 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946090 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946455 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946460 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946464 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946467 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946470 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946472 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946475 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946478 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946488 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946491 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946494 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946496 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946499 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946503 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946506 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946509 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946512 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946515 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:10:38.949558 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946517 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946520 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946523 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946526 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946528 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946531 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946534 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946537 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946539 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946542 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946544 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946548 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946551 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946554 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946557 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946560 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946562 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946565 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946568 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:10:38.950067 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946570 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946573 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946575 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946578 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946581 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946583 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946586 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946588 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946591 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946594 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946596 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946599 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946601 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946604 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946606 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946609 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946611 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946613 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946616 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:10:38.950519 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946618 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946621 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946624 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946627 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946629 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946631 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946634 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946636 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946638 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946641 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946643 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946645 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946648 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946651 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946653 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946655 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946658 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946661 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946663 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946666 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:10:38.950974 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946669 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946671 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946674 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946676 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946679 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946682 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946684 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946687 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946689 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946691 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946694 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946696 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946699 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946701 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946704 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946706 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946709 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946711 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946714 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946716 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:10:38.951567 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946722 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946724 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.946727 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946796 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946816 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946822 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946827 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946831 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946835 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946839 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946844 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946847 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946850 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946853 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946857 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946859 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946862 2570 flags.go:64] FLAG: --cgroup-root="" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946865 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946868 2570 flags.go:64] FLAG: --client-ca-file="" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946871 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946874 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946878 2570 flags.go:64] FLAG: --cluster-domain="" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946881 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946885 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 17:10:38.952057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946888 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946891 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946894 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946897 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946901 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946904 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946907 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946909 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946913 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946916 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946919 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946923 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946926 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946929 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946936 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946940 2570 flags.go:64] FLAG: --enable-server="true" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946943 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946947 2570 flags.go:64] FLAG: --event-burst="100" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946950 2570 flags.go:64] FLAG: --event-qps="50" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946953 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946956 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946959 2570 flags.go:64] FLAG: --eviction-hard="" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946962 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946965 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946968 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 17:10:38.952608 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946971 2570 flags.go:64] FLAG: --eviction-soft="" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946974 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946977 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946980 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946983 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946986 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946988 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946991 2570 flags.go:64] FLAG: --feature-gates="" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946995 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.946998 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947001 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947004 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947007 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947010 2570 flags.go:64] FLAG: --help="false" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947012 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-134-178.ec2.internal" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947016 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947019 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947022 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947026 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947029 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947032 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947035 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947039 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 17:10:38.953419 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947042 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947045 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947048 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947050 2570 flags.go:64] FLAG: --kube-reserved="" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947053 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947056 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947059 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947061 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947064 2570 flags.go:64] FLAG: --lock-file="" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947067 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947070 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947073 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947077 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947080 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947083 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947085 2570 flags.go:64] FLAG: --logging-format="text" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947088 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947092 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947094 2570 flags.go:64] FLAG: --manifest-url="" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947097 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947101 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947104 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947108 2570 flags.go:64] FLAG: --max-pods="110" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947111 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947114 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 17:10:38.954425 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947117 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947120 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947123 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947126 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947129 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947136 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947139 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947142 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947145 2570 flags.go:64] FLAG: --pod-cidr="" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947148 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947153 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947156 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947159 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947162 2570 flags.go:64] FLAG: --port="10250" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947165 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947168 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03fec0adee7d14199" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947171 2570 flags.go:64] FLAG: --qos-reserved="" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947174 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947177 2570 flags.go:64] FLAG: --register-node="true" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947179 2570 flags.go:64] FLAG: --register-with-taints="" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947183 2570 flags.go:64] FLAG: --registry-burst="10" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947186 2570 flags.go:64] FLAG: --registry-qps="5" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947189 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947192 2570 flags.go:64] FLAG: --reserved-memory="" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947195 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 17:10:38.955393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947199 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947202 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947205 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947208 2570 flags.go:64] FLAG: --runonce="false" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947211 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947214 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947217 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947222 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947225 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947228 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947231 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947234 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947237 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947240 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947243 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947246 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947250 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947253 2570 flags.go:64] FLAG: --system-cgroups="" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947255 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947261 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947264 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947267 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947271 2570 flags.go:64] FLAG: --tls-min-version="" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947274 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947277 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 17:10:38.956367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947279 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947282 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947285 2570 flags.go:64] FLAG: --v="2" Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947289 2570 flags.go:64] FLAG: --version="false" Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947295 2570 flags.go:64] FLAG: --vmodule="" Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947299 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947302 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947411 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947415 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947418 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947421 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947424 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947426 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947431 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947434 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947437 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947440 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947442 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947445 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947447 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947449 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:10:38.956982 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947452 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947454 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947457 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947460 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947463 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947465 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947468 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947470 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947473 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947476 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947478 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947481 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947484 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947486 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947489 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947491 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947494 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947496 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947498 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947501 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:10:38.957478 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947504 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947506 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947508 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947511 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947515 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947519 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947522 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947525 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947527 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947530 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947532 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947534 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947537 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947540 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947542 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947545 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947548 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947550 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947553 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:10:38.957968 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947556 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947559 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947561 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947564 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947566 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947569 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947571 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947574 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947576 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947580 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947583 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947586 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947589 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947591 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947595 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947598 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947601 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947605 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947609 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:10:38.958432 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947611 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947614 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947616 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947619 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947621 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947624 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947626 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947629 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947631 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947634 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947637 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947639 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947642 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947644 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947647 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947649 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947652 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947655 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947657 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:10:38.958887 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947660 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947664 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947667 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947670 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947673 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947676 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947678 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.947681 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.947687 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.956565 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.956580 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.957352 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.957361 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957438 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:10:38.959343 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957444 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957447 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957452 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957456 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957459 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957462 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957465 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957467 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957470 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957473 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957475 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957478 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957481 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957485 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957488 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957491 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957494 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957497 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957500 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:10:38.959681 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957502 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957505 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957508 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957511 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957514 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957516 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957519 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957522 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957525 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957528 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957531 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957534 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957537 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957540 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957542 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957545 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957548 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957550 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957553 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957555 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:10:38.960139 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957558 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957560 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957563 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957566 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957568 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957571 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957575 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957578 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957580 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957583 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957585 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957587 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957590 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957592 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957595 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957597 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957600 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957602 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957605 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957607 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:10:38.960608 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957610 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957613 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957616 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957618 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957622 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957625 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957628 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957630 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957633 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957636 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957639 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957641 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957644 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957647 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957649 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957652 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957654 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957657 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957659 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:10:38.961083 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957662 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957665 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957667 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957670 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957672 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957675 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957677 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957680 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957682 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957685 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957687 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957690 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957693 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957695 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957698 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957700 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957703 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957705 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957708 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:10:38.961538 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957711 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.957716 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957843 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957849 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957852 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957854 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957857 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957859 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957862 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957864 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957867 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957870 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957873 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957875 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:10:38.961997 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957878 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957881 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957884 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957886 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957889 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957891 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957894 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957896 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957899 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957901 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957904 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957906 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957909 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957911 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957914 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957917 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957919 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957921 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957924 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957926 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:10:38.962327 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957929 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957931 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957934 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957936 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957939 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957941 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957944 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957946 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957949 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957951 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957955 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957958 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957960 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957963 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957966 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957969 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957971 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957974 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957976 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:10:38.962791 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957979 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957982 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957985 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957987 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957989 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957992 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957994 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.957997 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958000 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958002 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958005 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958007 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958010 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958012 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958014 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958017 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958020 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958022 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958024 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958027 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:10:38.963255 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958030 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958032 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958034 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958037 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958039 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958042 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958045 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958047 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958050 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958052 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958055 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958061 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958064 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958066 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958069 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958072 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958074 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958077 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958081 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958084 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:10:38.963734 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958087 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958090 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958093 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958095 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958098 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958101 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958103 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:38.958106 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.958111 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.958226 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 17:10:38.964281 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.963061 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 17:10:38.964529 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.964315 2570 server.go:1019] "Starting client certificate rotation" Jul 28 17:10:38.964529 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.964411 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:10:38.964529 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.964463 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:10:38.967812 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.967790 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:10:38.968941 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.968927 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:10:38.977032 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.977015 2570 log.go:25] "Validated CRI v1 runtime API" Jul 28 17:10:38.978999 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.978985 2570 log.go:25] "Validated CRI v1 image API" Jul 28 17:10:38.984640 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.984625 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 17:10:38.987076 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.987059 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 aa766537-ee11-43f5-acd2-0cf6e293ec2c:/dev/nvme0n1p3 e5a63ad8-5913-454a-b22b-976ba5103276:/dev/nvme0n1p4] Jul 28 17:10:38.987123 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.987076 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 17:10:38.992360 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.992249 2570 manager.go:216] Machine: {Timestamp:2026-07-28 17:10:38.990927048 +0000 UTC m=+0.338807970 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200456 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec211c48587d8ebf373dc5f967b405aa SystemUUID:ec211c48-587d-8ebf-373d-c5f967b405aa BootID:96ed49ec-69ba-4c14-bfe7-bc1280c3cb4b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:b4:47:21:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:b4:47:21:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:05:89:35:d2:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 17:10:38.992360 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.992357 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 17:10:38.992474 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.992436 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 17:10:38.994793 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.994766 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 17:10:38.994944 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.994796 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 17:10:38.995450 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.995436 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 17:10:38.995481 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.995455 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 17:10:38.995481 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.995465 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:10:38.995635 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.995621 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:10:38.996577 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.996564 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:10:38.997391 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.997381 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 17:10:38.999136 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.999125 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:10:38.999262 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.999253 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 17:10:38.999290 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.999283 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 28 17:10:38.999316 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.999295 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 17:10:38.999342 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.999316 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 17:10:38.999342 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.999329 2570 kubelet.go:398] "Adding apiserver pod source" Jul 28 17:10:38.999407 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:38.999388 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 17:10:39.001326 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.001269 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:10:39.001417 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.001355 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:10:39.004552 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.004526 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 17:10:39.006380 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.006367 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 17:10:39.006429 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.006396 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 17:10:39.008065 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008053 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 17:10:39.008110 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008072 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 17:10:39.008110 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008081 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 17:10:39.008110 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008089 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 17:10:39.008110 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008101 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 17:10:39.008110 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008106 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 17:10:39.008236 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008114 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 17:10:39.008236 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008119 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 17:10:39.008236 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008126 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 17:10:39.008236 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008131 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 17:10:39.008236 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008139 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 17:10:39.008236 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.008144 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 17:10:39.009166 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.009154 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 17:10:39.009210 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.009168 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 17:10:39.011579 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.011561 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 17:10:39.011952 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.011914 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 17:10:39.012060 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.012037 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 17:10:39.012383 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.012370 2570 server.go:1268] "Started kubelet" Jul 28 17:10:39.012466 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.012440 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 17:10:39.012522 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.012458 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 17:10:39.012563 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.012545 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 17:10:39.013303 ip-10-0-134-178 systemd[1]: Started Kubernetes Kubelet. Jul 28 17:10:39.014293 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.014227 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 17:10:39.014609 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.014597 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 28 17:10:39.018233 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.017239 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-178.ec2.internal.18c68346028729c2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-178.ec2.internal,UID:ip-10-0-134-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-178.ec2.internal,},FirstTimestamp:2026-07-28 17:10:39.01234221 +0000 UTC m=+0.360223133,LastTimestamp:2026-07-28 17:10:39.01234221 +0000 UTC m=+0.360223133,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-178.ec2.internal,}" Jul 28 17:10:39.019549 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.019531 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 17:10:39.022149 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.022128 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 17:10:39.022240 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.022133 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 17:10:39.022290 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.022267 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.022897 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.022882 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 17:10:39.023010 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.022994 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 17:10:39.023077 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023014 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 17:10:39.023077 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023032 2570 factory.go:55] Registering systemd factory Jul 28 17:10:39.023077 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023048 2570 factory.go:223] Registration of the systemd container factory successfully Jul 28 17:10:39.023216 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023120 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 28 17:10:39.023216 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023130 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 28 17:10:39.023296 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023261 2570 factory.go:153] Registering CRI-O factory Jul 28 17:10:39.023296 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023274 2570 factory.go:223] Registration of the crio container factory successfully Jul 28 17:10:39.023381 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023329 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 17:10:39.023381 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023351 2570 factory.go:103] Registering Raw factory Jul 28 17:10:39.023381 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023366 2570 manager.go:1196] Started watching for new ooms in manager Jul 28 17:10:39.023735 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023721 2570 manager.go:349] Starting recovery of all containers Jul 28 17:10:39.023833 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.023817 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lv4f" Jul 28 17:10:39.024793 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.024761 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 17:10:39.024906 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.024871 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 17:10:39.032603 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.032573 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lv4f" Jul 28 17:10:39.036583 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.036564 2570 manager.go:354] Recovery completed Jul 28 17:10:39.040973 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.040961 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:10:39.043215 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.043199 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:10:39.043293 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.043231 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:10:39.043293 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.043247 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:10:39.043793 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.043778 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 17:10:39.043793 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.043791 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 17:10:39.043793 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.043796 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:10:39.043970 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.043819 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:10:39.044508 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.044494 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:10:39.044578 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.044524 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:10:39.044578 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.044538 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:10:39.045361 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.045348 2570 policy_none.go:49] "None policy: Start" Jul 28 17:10:39.045411 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.045363 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 17:10:39.045411 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.045373 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 17:10:39.046700 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.046690 2570 policy_none.go:47] "Start" Jul 28 17:10:39.085600 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.085420 2570 manager.go:337] "Starting Device Plugin manager" Jul 28 17:10:39.085696 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.085627 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 17:10:39.085696 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.085644 2570 server.go:87] "Starting device plugin registration server" Jul 28 17:10:39.085920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.085908 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 17:10:39.085956 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.085923 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 17:10:39.086028 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.086013 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 17:10:39.086112 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.086100 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 17:10:39.086164 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.086114 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 17:10:39.086838 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.086820 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 17:10:39.086954 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.086874 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.186054 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.186012 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:10:39.187552 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.187060 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:10:39.187552 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.187102 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:10:39.187552 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.187118 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:10:39.187552 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.187146 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.193404 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.193386 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.193488 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.193412 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-178.ec2.internal\": node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.211290 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.211268 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.218147 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.218114 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 17:10:39.219416 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.219398 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 17:10:39.219475 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.219438 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 17:10:39.219475 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.219461 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 17:10:39.219567 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.219494 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 17:10:39.221386 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.221367 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:10:39.316334 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.316268 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.319632 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.319606 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal"] Jul 28 17:10:39.319694 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.319682 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:10:39.321406 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.321388 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:10:39.321489 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.321420 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:10:39.321489 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.321431 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:10:39.323204 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.323190 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:10:39.323319 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.323304 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.323366 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.323348 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:10:39.323406 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.323371 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/802e94b6ca2fdea2f3a6672231023aac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-178.ec2.internal\" (UID: \"802e94b6ca2fdea2f3a6672231023aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.323454 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.323413 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c4386e55f9cbe9814742507e478db6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal\" (UID: \"1c4386e55f9cbe9814742507e478db6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.323499 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.323477 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4386e55f9cbe9814742507e478db6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal\" (UID: \"1c4386e55f9cbe9814742507e478db6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.324033 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.324016 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:10:39.324087 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.324041 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:10:39.324087 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.324052 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:10:39.324148 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.324022 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:10:39.324148 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.324112 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:10:39.324148 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.324129 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:10:39.325360 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.325339 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.325403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.325371 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:10:39.326089 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.326071 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:10:39.326089 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.326091 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:10:39.326258 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.326101 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:10:39.346725 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.346701 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-178.ec2.internal\" not found" node="ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.351287 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.351270 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-178.ec2.internal\" not found" node="ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.417334 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.417306 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.423957 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.423928 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4386e55f9cbe9814742507e478db6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal\" (UID: \"1c4386e55f9cbe9814742507e478db6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.424093 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.423959 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/802e94b6ca2fdea2f3a6672231023aac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-178.ec2.internal\" (UID: \"802e94b6ca2fdea2f3a6672231023aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.424093 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.423979 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c4386e55f9cbe9814742507e478db6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal\" (UID: \"1c4386e55f9cbe9814742507e478db6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.424093 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.424021 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4386e55f9cbe9814742507e478db6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal\" (UID: \"1c4386e55f9cbe9814742507e478db6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.424093 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.424033 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c4386e55f9cbe9814742507e478db6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal\" (UID: \"1c4386e55f9cbe9814742507e478db6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.424093 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.424049 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/802e94b6ca2fdea2f3a6672231023aac-config\") pod \"kube-apiserver-proxy-ip-10-0-134-178.ec2.internal\" (UID: \"802e94b6ca2fdea2f3a6672231023aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.517936 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.517843 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.624992 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.624959 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.649574 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.649524 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.654890 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.654855 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" Jul 28 17:10:39.725207 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.725164 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.825829 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.825744 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.926462 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:39.926413 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:39.963449 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.963415 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 17:10:39.963884 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:39.963581 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:10:40.007189 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.007156 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:10:40.026750 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:40.026724 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:40.041872 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.041830 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:05:39 +0000 UTC" deadline="2028-05-07 12:12:52.598768602 +0000 UTC" Jul 28 17:10:40.041872 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.041883 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15571h2m12.556905367s" Jul 28 17:10:40.127230 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:40.127199 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:40.227394 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:40.227371 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:40.235481 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:40.235436 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802e94b6ca2fdea2f3a6672231023aac.slice/crio-6a3131af9c34c77446096fd7b68676d357fb8459fd14ba6be73fd93dbacc85bb WatchSource:0}: Error finding container 6a3131af9c34c77446096fd7b68676d357fb8459fd14ba6be73fd93dbacc85bb: Status 404 returned error can't find the container with id 6a3131af9c34c77446096fd7b68676d357fb8459fd14ba6be73fd93dbacc85bb Jul 28 17:10:40.241141 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.241126 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:10:40.328105 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:40.328070 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:40.371009 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:40.370979 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4386e55f9cbe9814742507e478db6e.slice/crio-81c4c2db436c6466354ce8f76a8c90e841f5cd1f6109ee863a2173bbd21a33c6 WatchSource:0}: Error finding container 81c4c2db436c6466354ce8f76a8c90e841f5cd1f6109ee863a2173bbd21a33c6: Status 404 returned error can't find the container with id 81c4c2db436c6466354ce8f76a8c90e841f5cd1f6109ee863a2173bbd21a33c6 Jul 28 17:10:40.428938 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:40.428907 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-178.ec2.internal\" not found" Jul 28 17:10:40.472952 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.472925 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:10:40.523012 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.522979 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" Jul 28 17:10:40.535785 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.535765 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:10:40.537414 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.537397 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" Jul 28 17:10:40.547956 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.547938 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:10:40.553441 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:40.553422 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:10:41.002496 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.002458 2570 apiserver.go:52] "Watching apiserver" Jul 28 17:10:41.012014 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.011988 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 17:10:41.012432 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.012408 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal","openshift-multus/multus-additional-cni-plugins-vfbgc","openshift-multus/multus-cqt2f","openshift-multus/network-metrics-daemon-bbztf","kube-system/global-pull-secret-syncer-227qv","kube-system/konnectivity-agent-kb9wj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8","openshift-cluster-node-tuning-operator/tuned-lldlc","openshift-network-diagnostics/network-check-target-mlskw","openshift-network-operator/iptables-alerter-pvd2h","openshift-ovn-kubernetes/ovnkube-node-bnt2g","kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal","openshift-dns/node-resolver-tvjwr","openshift-image-registry/node-ca-n7mrd"] Jul 28 17:10:41.014111 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.014091 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.015699 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.015678 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.017221 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.017200 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.017577 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.017430 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xmhq9\"" Jul 28 17:10:41.017577 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.017451 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 17:10:41.017726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.017641 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 17:10:41.017829 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.017787 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 17:10:41.018618 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.018596 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:41.018709 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.018669 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:41.019407 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.019378 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 17:10:41.019499 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.019384 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 17:10:41.021578 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.021557 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 17:10:41.021709 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.021682 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-czz62\"" Jul 28 17:10:41.021984 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.021962 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 17:10:41.022228 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.022066 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.022228 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.022085 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 17:10:41.022228 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.022092 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 17:10:41.022611 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.022361 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 17:10:41.022611 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.022427 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 17:10:41.022754 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.022723 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 17:10:41.023595 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.023503 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 17:10:41.023691 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.023597 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-th2l2\"" Jul 28 17:10:41.023818 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.023802 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 17:10:41.024182 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.024163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:10:41.024972 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.024952 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 17:10:41.025307 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.025181 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:41.025307 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.025247 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:41.025462 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.025353 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 17:10:41.025676 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.025583 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vtdfb\"" Jul 28 17:10:41.025794 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.025781 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 17:10:41.027147 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.026937 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 17:10:41.027147 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.026954 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.027147 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.027017 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-889pl\"" Jul 28 17:10:41.027147 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.027118 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 17:10:41.028401 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.028382 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.029341 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.029324 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 17:10:41.029687 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.029663 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 17:10:41.029890 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.029785 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.030278 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.030259 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tkgwg\"" Jul 28 17:10:41.031065 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.031047 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 17:10:41.031387 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.031365 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.031600 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.031579 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:10:41.031835 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.031819 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hbj9q\"" Jul 28 17:10:41.032903 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.032867 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.033003 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.032889 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-cni-netd\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033003 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.032944 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5wzf\" (UniqueName: \"kubernetes.io/projected/aacd0446-d9ac-4f0a-be87-d48f388d24d8-kube-api-access-f5wzf\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033003 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.032942 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:41.033003 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.032973 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-etc-kubernetes\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.033003 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.032997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-socket-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.033260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033021 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs5w6\" (UniqueName: \"kubernetes.io/projected/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-kube-api-access-fs5w6\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.033260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-kubelet\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033090 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-slash\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033113 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-node-log\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033153 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-k8s-cni-cncf-io\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.033260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033185 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-cni-bin\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.033260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033212 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3113a92-c6d2-46c4-99fe-94d1e5bb6fab-agent-certs\") pod \"konnectivity-agent-kb9wj\" (UID: \"d3113a92-c6d2-46c4-99fe-94d1e5bb6fab\") " pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:10:41.033260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033251 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-systemd\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033293 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovn-node-metrics-cert\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovnkube-script-lib\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033385 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-cni-multus\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033429 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzst7\" (UniqueName: \"kubernetes.io/projected/e867cc7b-e212-4f81-b221-c346948ec4a0-kube-api-access-mzst7\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3113a92-c6d2-46c4-99fe-94d1e5bb6fab-konnectivity-ca\") pod \"konnectivity-agent-kb9wj\" (UID: \"d3113a92-c6d2-46c4-99fe-94d1e5bb6fab\") " pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-registration-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-run-netns\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033561 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 17:10:41.033650 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033642 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 17:10:41.034115 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033759 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:10:41.034115 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033898 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g2scz\"" Jul 28 17:10:41.034115 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.033565 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-ovn\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.034115 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-cni-bin\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.034115 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-cni-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.034343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-cnibin\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.034343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034135 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 17:10:41.034343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034143 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e867cc7b-e212-4f81-b221-c346948ec4a0-cni-binary-copy\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.034343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034193 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-hostroot\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.034343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034216 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-env-overrides\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.034343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034254 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-var-lib-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034370 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034405 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-netns\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034448 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-conf-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034471 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-daemon-config\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034486 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034519 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034539 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-device-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-systemd-units\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034586 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-etc-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034600 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovnkube-config\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.034622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034622 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-system-cni-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034646 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx44q\" (UniqueName: \"kubernetes.io/projected/e94fa4fc-230d-4bca-91da-de6bae60cb56-kube-api-access-vx44q\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-sys-fs\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034701 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-os-release\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-socket-dir-parent\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034778 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-kubelet\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034810 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-multus-certs\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034857 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034874 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af54ed7f-261b-4812-9c63-0ec01331f266-serviceca\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034894 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np5fq\" (UniqueName: \"kubernetes.io/projected/af54ed7f-261b-4812-9c63-0ec01331f266-kube-api-access-np5fq\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.034929 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af54ed7f-261b-4812-9c63-0ec01331f266-host\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.035044 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tgdmh\"" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.035087 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.035111 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.035168 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-log-socket\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.035205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.035198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.036307 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.036288 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:10:41.067676 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.067638 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qg4c9" Jul 28 17:10:41.078000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.077973 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qg4c9" Jul 28 17:10:41.124132 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.124105 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 17:10:41.135822 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-os-release\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.135997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135838 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-socket-dir-parent\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.135997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135857 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-kubelet\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.135997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135877 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.135997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysctl-conf\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.135997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135928 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5v6z\" (UniqueName: \"kubernetes.io/projected/06ba6b63-6e18-4226-b614-cd94fb74026a-kube-api-access-z5v6z\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.135997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135975 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-os-release\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.135997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135976 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-socket-dir-parent\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.135997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135976 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-kubelet\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.135997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-system-cni-dir\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136047 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136076 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-hosts-file\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136101 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-var-lib-kubelet\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136160 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-cni-netd\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136173 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136185 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs5w6\" (UniqueName: \"kubernetes.io/projected/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-kube-api-access-fs5w6\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136206 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-cni-netd\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136220 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-kubelet\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136245 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-slash\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136269 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-node-log\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136277 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-kubelet\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136295 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-k8s-cni-cncf-io\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136315 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-slash\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136322 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3113a92-c6d2-46c4-99fe-94d1e5bb6fab-agent-certs\") pod \"konnectivity-agent-kb9wj\" (UID: \"d3113a92-c6d2-46c4-99fe-94d1e5bb6fab\") " pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:10:41.136397 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136348 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5234cca-d671-40ff-b9cd-e4e184221349-host-slash\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136353 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-k8s-cni-cncf-io\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136374 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-kubelet-config\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136378 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-node-log\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136401 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-systemd\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136443 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-systemd\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136436 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3113a92-c6d2-46c4-99fe-94d1e5bb6fab-konnectivity-ca\") pod \"konnectivity-agent-kb9wj\" (UID: \"d3113a92-c6d2-46c4-99fe-94d1e5bb6fab\") " pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136515 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-kubernetes\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-systemd\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-tuned\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136689 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-ovn\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136717 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-cni-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136741 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-cnibin\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136759 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-run-ovn\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e867cc7b-e212-4f81-b221-c346948ec4a0-cni-binary-copy\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136716 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136880 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-cnibin\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136916 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-conf-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.137403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136944 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136969 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-cni-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.136974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysconfig\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137021 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-conf-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137069 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-sys\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-os-release\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137125 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137131 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3113a92-c6d2-46c4-99fe-94d1e5bb6fab-konnectivity-ca\") pod \"konnectivity-agent-kb9wj\" (UID: \"d3113a92-c6d2-46c4-99fe-94d1e5bb6fab\") " pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137140 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137194 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-tmp-dir\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-lib-modules\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137255 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-host\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137327 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06ba6b63-6e18-4226-b614-cd94fb74026a-tmp\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137391 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-systemd-units\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137423 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-sys-fs\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137436 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e867cc7b-e212-4f81-b221-c346948ec4a0-cni-binary-copy\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137450 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-multus-certs\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.138330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137495 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-systemd-units\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137505 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w8gz\" (UniqueName: \"kubernetes.io/projected/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-kube-api-access-5w8gz\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137512 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-multus-certs\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137541 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkbl\" (UniqueName: \"kubernetes.io/projected/e5234cca-d671-40ff-b9cd-e4e184221349-kube-api-access-xpkbl\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137553 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-sys-fs\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137566 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysctl-d\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137592 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-run\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137621 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137650 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-log-socket\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137677 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137690 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-log-socket\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137702 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5wzf\" (UniqueName: \"kubernetes.io/projected/aacd0446-d9ac-4f0a-be87-d48f388d24d8-kube-api-access-f5wzf\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137728 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-etc-kubernetes\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137730 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137751 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137758 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-cnibin\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-socket-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.139174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137801 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-etc-kubernetes\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137832 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-cni-bin\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5234cca-d671-40ff-b9cd-e4e184221349-iptables-alerter-script\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137894 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-cni-bin\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137896 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovn-node-metrics-cert\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.137978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovnkube-script-lib\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138014 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-socket-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-cni-multus\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138067 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzst7\" (UniqueName: \"kubernetes.io/projected/e867cc7b-e212-4f81-b221-c346948ec4a0-kube-api-access-mzst7\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138092 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-var-lib-cni-multus\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138095 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138153 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-registration-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138186 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-run-netns\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-cni-bin\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138241 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-hostroot\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138267 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-daemon-config\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138273 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-registration-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.140000 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138311 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138328 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-cni-bin\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138336 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af54ed7f-261b-4812-9c63-0ec01331f266-serviceca\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-modprobe-d\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138385 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-hostroot\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138428 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af54ed7f-261b-4812-9c63-0ec01331f266-host\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-env-overrides\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-var-lib-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138515 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138544 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-netns\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vhdj\" (UniqueName: \"kubernetes.io/projected/19a27f5c-91b5-4084-85b4-7458623dc52a-kube-api-access-4vhdj\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138596 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-dbus\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138647 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138661 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovnkube-script-lib\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-device-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138715 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-device-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138759 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-etc-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.140995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138764 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-run-netns\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138812 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovnkube-config\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-system-cni-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138890 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx44q\" (UniqueName: \"kubernetes.io/projected/e94fa4fc-230d-4bca-91da-de6bae60cb56-kube-api-access-vx44q\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.138920 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138936 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e867cc7b-e212-4f81-b221-c346948ec4a0-multus-daemon-config\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138923 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np5fq\" (UniqueName: \"kubernetes.io/projected/af54ed7f-261b-4812-9c63-0ec01331f266-kube-api-access-np5fq\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.139007 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs podName:e94fa4fc-230d-4bca-91da-de6bae60cb56 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:41.638969976 +0000 UTC m=+2.986850909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs") pod "network-metrics-daemon-bbztf" (UID: "e94fa4fc-230d-4bca-91da-de6bae60cb56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.138815 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af54ed7f-261b-4812-9c63-0ec01331f266-serviceca\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139162 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-system-cni-dir\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139192 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-env-overrides\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139243 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139282 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af54ed7f-261b-4812-9c63-0ec01331f266-host\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139304 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139344 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e867cc7b-e212-4f81-b221-c346948ec4a0-host-run-netns\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139247 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-var-lib-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139367 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacd0446-d9ac-4f0a-be87-d48f388d24d8-etc-openvswitch\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.141906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.139521 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovnkube-config\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.142793 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.140714 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aacd0446-d9ac-4f0a-be87-d48f388d24d8-ovn-node-metrics-cert\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.142793 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.140751 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3113a92-c6d2-46c4-99fe-94d1e5bb6fab-agent-certs\") pod \"konnectivity-agent-kb9wj\" (UID: \"d3113a92-c6d2-46c4-99fe-94d1e5bb6fab\") " pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:10:41.154043 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.154003 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs5w6\" (UniqueName: \"kubernetes.io/projected/a9ab28fe-8bec-4971-a1d6-eeaed4d614d5-kube-api-access-fs5w6\") pod \"aws-ebs-csi-driver-node-vk7k8\" (UID: \"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.154194 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.154160 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np5fq\" (UniqueName: \"kubernetes.io/projected/af54ed7f-261b-4812-9c63-0ec01331f266-kube-api-access-np5fq\") pod \"node-ca-n7mrd\" (UID: \"af54ed7f-261b-4812-9c63-0ec01331f266\") " pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.154338 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.154306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5wzf\" (UniqueName: \"kubernetes.io/projected/aacd0446-d9ac-4f0a-be87-d48f388d24d8-kube-api-access-f5wzf\") pod \"ovnkube-node-bnt2g\" (UID: \"aacd0446-d9ac-4f0a-be87-d48f388d24d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.154884 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.154862 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx44q\" (UniqueName: \"kubernetes.io/projected/e94fa4fc-230d-4bca-91da-de6bae60cb56-kube-api-access-vx44q\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:41.155101 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.155078 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzst7\" (UniqueName: \"kubernetes.io/projected/e867cc7b-e212-4f81-b221-c346948ec4a0-kube-api-access-mzst7\") pod \"multus-cqt2f\" (UID: \"e867cc7b-e212-4f81-b221-c346948ec4a0\") " pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.163870 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.163844 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:10:41.226201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.226140 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" event={"ID":"1c4386e55f9cbe9814742507e478db6e","Type":"ContainerStarted","Data":"81c4c2db436c6466354ce8f76a8c90e841f5cd1f6109ee863a2173bbd21a33c6"} Jul 28 17:10:41.227508 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.227477 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" event={"ID":"802e94b6ca2fdea2f3a6672231023aac","Type":"ContainerStarted","Data":"6a3131af9c34c77446096fd7b68676d357fb8459fd14ba6be73fd93dbacc85bb"} Jul 28 17:10:41.240213 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240177 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5234cca-d671-40ff-b9cd-e4e184221349-iptables-alerter-script\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.240393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240234 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.240393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240311 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-modprobe-d\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.240393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240343 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vhdj\" (UniqueName: \"kubernetes.io/projected/19a27f5c-91b5-4084-85b4-7458623dc52a-kube-api-access-4vhdj\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.240393 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240367 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-dbus\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240399 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240460 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysctl-conf\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240488 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5v6z\" (UniqueName: \"kubernetes.io/projected/06ba6b63-6e18-4226-b614-cd94fb74026a-kube-api-access-z5v6z\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-system-cni-dir\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240523 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-hosts-file\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240552 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-var-lib-kubelet\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5234cca-d671-40ff-b9cd-e4e184221349-host-slash\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.240614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240597 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-kubelet-config\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240624 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-kubernetes\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240647 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-systemd\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240669 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-tuned\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240689 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-dbus\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240706 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240712 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-modprobe-d\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240690 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-var-lib-kubelet\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240737 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-hosts-file\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240737 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysconfig\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240780 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-sys\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240790 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysconfig\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.240824 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240835 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-kubernetes\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240853 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-sys\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240836 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-system-cni-dir\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.240913 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret podName:58620e3a-8378-46e5-9d7a-aaf8e78edf6b nodeName:}" failed. No retries permitted until 2026-07-28 17:10:41.740892349 +0000 UTC m=+3.088773274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret") pod "global-pull-secret-syncer-227qv" (UID: "58620e3a-8378-46e5-9d7a-aaf8e78edf6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:41.241068 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240913 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5234cca-d671-40ff-b9cd-e4e184221349-iptables-alerter-script\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240913 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-systemd\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-os-release\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240980 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240984 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5234cca-d671-40ff-b9cd-e4e184221349-host-slash\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.240995 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysctl-conf\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241049 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-os-release\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241007 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241096 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-tmp-dir\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241158 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-kubelet-config\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-lib-modules\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241224 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-host\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06ba6b63-6e18-4226-b614-cd94fb74026a-tmp\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241271 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.241920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.241734 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-tmp-dir\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.242668 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.242324 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.242668 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.242355 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.242668 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.242412 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19a27f5c-91b5-4084-85b4-7458623dc52a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.242668 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.242429 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w8gz\" (UniqueName: \"kubernetes.io/projected/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-kube-api-access-5w8gz\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.242668 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.242543 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-host\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.242972 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.242949 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkbl\" (UniqueName: \"kubernetes.io/projected/e5234cca-d671-40ff-b9cd-e4e184221349-kube-api-access-xpkbl\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.242972 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.242953 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-lib-modules\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.243712 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.243681 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysctl-d\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.243833 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.243752 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-run\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.243934 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.243908 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-sysctl-d\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.244067 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.243971 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06ba6b63-6e18-4226-b614-cd94fb74026a-run\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.244067 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.244057 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-cnibin\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.244183 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.244156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19a27f5c-91b5-4084-85b4-7458623dc52a-cnibin\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.245319 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.245294 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06ba6b63-6e18-4226-b614-cd94fb74026a-tmp\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.247213 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.247193 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06ba6b63-6e18-4226-b614-cd94fb74026a-etc-tuned\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.249380 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.249296 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:10:41.249380 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.249321 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:10:41.249380 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.249335 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fcz22 for pod openshift-network-diagnostics/network-check-target-mlskw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:41.249722 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.249420 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22 podName:2b9c67ba-8430-44b2-8779-aa136c0c6f17 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:41.749401603 +0000 UTC m=+3.097282516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fcz22" (UniqueName: "kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22") pod "network-check-target-mlskw" (UID: "2b9c67ba-8430-44b2-8779-aa136c0c6f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:41.251588 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.251559 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vhdj\" (UniqueName: \"kubernetes.io/projected/19a27f5c-91b5-4084-85b4-7458623dc52a-kube-api-access-4vhdj\") pod \"multus-additional-cni-plugins-vfbgc\" (UID: \"19a27f5c-91b5-4084-85b4-7458623dc52a\") " pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.252004 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.251983 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5v6z\" (UniqueName: \"kubernetes.io/projected/06ba6b63-6e18-4226-b614-cd94fb74026a-kube-api-access-z5v6z\") pod \"tuned-lldlc\" (UID: \"06ba6b63-6e18-4226-b614-cd94fb74026a\") " pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.252786 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.252723 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w8gz\" (UniqueName: \"kubernetes.io/projected/aa48fe6a-6d93-4b17-b269-4e26f1d11c05-kube-api-access-5w8gz\") pod \"node-resolver-tvjwr\" (UID: \"aa48fe6a-6d93-4b17-b269-4e26f1d11c05\") " pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.253079 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.253056 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkbl\" (UniqueName: \"kubernetes.io/projected/e5234cca-d671-40ff-b9cd-e4e184221349-kube-api-access-xpkbl\") pod \"iptables-alerter-pvd2h\" (UID: \"e5234cca-d671-40ff-b9cd-e4e184221349\") " pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.327293 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.327252 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" Jul 28 17:10:41.333882 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.333858 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:10:41.344016 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.343980 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqt2f" Jul 28 17:10:41.349310 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.349285 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n7mrd" Jul 28 17:10:41.356624 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.356603 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:10:41.363532 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.363506 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tvjwr" Jul 28 17:10:41.371669 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.371636 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lldlc" Jul 28 17:10:41.380763 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.380739 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pvd2h" Jul 28 17:10:41.386954 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.386931 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" Jul 28 17:10:41.647777 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.647742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:41.647967 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.647935 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:41.648026 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.648019 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs podName:e94fa4fc-230d-4bca-91da-de6bae60cb56 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:42.647989974 +0000 UTC m=+3.995870884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs") pod "network-metrics-daemon-bbztf" (UID: "e94fa4fc-230d-4bca-91da-de6bae60cb56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:41.748468 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.748424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:41.748667 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.748617 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:41.748718 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.748704 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret podName:58620e3a-8378-46e5-9d7a-aaf8e78edf6b nodeName:}" failed. No retries permitted until 2026-07-28 17:10:42.748684708 +0000 UTC m=+4.096565622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret") pod "global-pull-secret-syncer-227qv" (UID: "58620e3a-8378-46e5-9d7a-aaf8e78edf6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:41.849318 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:41.849283 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:41.849485 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.849463 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:10:41.849550 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.849489 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:10:41.849550 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.849500 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fcz22 for pod openshift-network-diagnostics/network-check-target-mlskw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:41.849626 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:41.849553 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22 podName:2b9c67ba-8430-44b2-8779-aa136c0c6f17 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:42.849539451 +0000 UTC m=+4.197420367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcz22" (UniqueName: "kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22") pod "network-check-target-mlskw" (UID: "2b9c67ba-8430-44b2-8779-aa136c0c6f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:42.080789 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.080673 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:05:41 +0000 UTC" deadline="2028-01-16 13:15:33.105936301 +0000 UTC" Jul 28 17:10:42.080789 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.080735 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12884h4m51.025206256s" Jul 28 17:10:42.218323 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:42.218285 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a27f5c_91b5_4084_85b4_7458623dc52a.slice/crio-385f976f7485821d301f22338b166c918ea8466882a5b16547c985e7ef9c4331 WatchSource:0}: Error finding container 385f976f7485821d301f22338b166c918ea8466882a5b16547c985e7ef9c4331: Status 404 returned error can't find the container with id 385f976f7485821d301f22338b166c918ea8466882a5b16547c985e7ef9c4331 Jul 28 17:10:42.221212 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.220268 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:42.221212 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.220382 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:42.221899 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:42.221793 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacd0446_d9ac_4f0a_be87_d48f388d24d8.slice/crio-97bba231240808439ad6703df9f947ac2efa5c08da36a8e3f362ecbb477e23b3 WatchSource:0}: Error finding container 97bba231240808439ad6703df9f947ac2efa5c08da36a8e3f362ecbb477e23b3: Status 404 returned error can't find the container with id 97bba231240808439ad6703df9f947ac2efa5c08da36a8e3f362ecbb477e23b3 Jul 28 17:10:42.222315 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:42.222258 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa48fe6a_6d93_4b17_b269_4e26f1d11c05.slice/crio-e4c07cdd198edf7ac32c5ef3502259eff7e36f939cd443f7ae78c4ba868aa497 WatchSource:0}: Error finding container e4c07cdd198edf7ac32c5ef3502259eff7e36f939cd443f7ae78c4ba868aa497: Status 404 returned error can't find the container with id e4c07cdd198edf7ac32c5ef3502259eff7e36f939cd443f7ae78c4ba868aa497 Jul 28 17:10:42.223763 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:42.223526 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3113a92_c6d2_46c4_99fe_94d1e5bb6fab.slice/crio-74f1b7c42f3842fc63fb00ff3652fac0ee240ac3f0305cfcd788d3ec4284ce0a WatchSource:0}: Error finding container 74f1b7c42f3842fc63fb00ff3652fac0ee240ac3f0305cfcd788d3ec4284ce0a: Status 404 returned error can't find the container with id 74f1b7c42f3842fc63fb00ff3652fac0ee240ac3f0305cfcd788d3ec4284ce0a Jul 28 17:10:42.226104 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:42.226082 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode867cc7b_e212_4f81_b221_c346948ec4a0.slice/crio-444bbe39018eb0646f6915dc697fcf96c91af30d6482fa5163f6e0c35c83d260 WatchSource:0}: Error finding container 444bbe39018eb0646f6915dc697fcf96c91af30d6482fa5163f6e0c35c83d260: Status 404 returned error can't find the container with id 444bbe39018eb0646f6915dc697fcf96c91af30d6482fa5163f6e0c35c83d260 Jul 28 17:10:42.228943 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:42.228917 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf54ed7f_261b_4812_9c63_0ec01331f266.slice/crio-d0ba0b501f3f355d921eb7d0872d47695ba7aa3bd2d2321876957f8f46509bbb WatchSource:0}: Error finding container d0ba0b501f3f355d921eb7d0872d47695ba7aa3bd2d2321876957f8f46509bbb: Status 404 returned error can't find the container with id d0ba0b501f3f355d921eb7d0872d47695ba7aa3bd2d2321876957f8f46509bbb Jul 28 17:10:42.229955 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:42.229924 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ba6b63_6e18_4226_b614_cd94fb74026a.slice/crio-011f8b7764958c4dfee62b8e372d93530b706fdc803296bffbc8a428b8b5085c WatchSource:0}: Error finding container 011f8b7764958c4dfee62b8e372d93530b706fdc803296bffbc8a428b8b5085c: Status 404 returned error can't find the container with id 011f8b7764958c4dfee62b8e372d93530b706fdc803296bffbc8a428b8b5085c Jul 28 17:10:42.230316 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.230278 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" event={"ID":"19a27f5c-91b5-4084-85b4-7458623dc52a","Type":"ContainerStarted","Data":"385f976f7485821d301f22338b166c918ea8466882a5b16547c985e7ef9c4331"} Jul 28 17:10:42.234048 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:10:42.233761 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5234cca_d671_40ff_b9cd_e4e184221349.slice/crio-a1383b4b14bd1191deec44c55f80b65a21e0a0821e81236ead94c3cc00b01a1a WatchSource:0}: Error finding container a1383b4b14bd1191deec44c55f80b65a21e0a0821e81236ead94c3cc00b01a1a: Status 404 returned error can't find the container with id a1383b4b14bd1191deec44c55f80b65a21e0a0821e81236ead94c3cc00b01a1a Jul 28 17:10:42.234048 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.233968 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqt2f" event={"ID":"e867cc7b-e212-4f81-b221-c346948ec4a0","Type":"ContainerStarted","Data":"444bbe39018eb0646f6915dc697fcf96c91af30d6482fa5163f6e0c35c83d260"} Jul 28 17:10:42.236322 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.236298 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kb9wj" event={"ID":"d3113a92-c6d2-46c4-99fe-94d1e5bb6fab","Type":"ContainerStarted","Data":"74f1b7c42f3842fc63fb00ff3652fac0ee240ac3f0305cfcd788d3ec4284ce0a"} Jul 28 17:10:42.237692 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.237613 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"97bba231240808439ad6703df9f947ac2efa5c08da36a8e3f362ecbb477e23b3"} Jul 28 17:10:42.239016 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.238991 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tvjwr" event={"ID":"aa48fe6a-6d93-4b17-b269-4e26f1d11c05","Type":"ContainerStarted","Data":"e4c07cdd198edf7ac32c5ef3502259eff7e36f939cd443f7ae78c4ba868aa497"} Jul 28 17:10:42.660175 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.659852 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:42.660175 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.660154 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:42.660399 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.660247 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs podName:e94fa4fc-230d-4bca-91da-de6bae60cb56 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:44.660214615 +0000 UTC m=+6.008095529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs") pod "network-metrics-daemon-bbztf" (UID: "e94fa4fc-230d-4bca-91da-de6bae60cb56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:42.761908 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.761295 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:42.761908 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.761474 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:42.761908 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.761538 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret podName:58620e3a-8378-46e5-9d7a-aaf8e78edf6b nodeName:}" failed. No retries permitted until 2026-07-28 17:10:44.761518992 +0000 UTC m=+6.109399917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret") pod "global-pull-secret-syncer-227qv" (UID: "58620e3a-8378-46e5-9d7a-aaf8e78edf6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:42.862011 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:42.861974 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:42.862214 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.862186 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:10:42.862214 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.862213 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:10:42.862323 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.862228 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fcz22 for pod openshift-network-diagnostics/network-check-target-mlskw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:42.862323 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:42.862289 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22 podName:2b9c67ba-8430-44b2-8779-aa136c0c6f17 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:44.8622699 +0000 UTC m=+6.210150814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcz22" (UniqueName: "kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22") pod "network-check-target-mlskw" (UID: "2b9c67ba-8430-44b2-8779-aa136c0c6f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:43.081178 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.081083 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:05:41 +0000 UTC" deadline="2028-03-09 00:44:16.256390524 +0000 UTC" Jul 28 17:10:43.081178 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.081147 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14143h33m33.175248244s" Jul 28 17:10:43.223249 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.222480 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:43.223249 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:43.222617 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:43.223249 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.223042 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:43.223249 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:43.223153 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:43.266209 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.265289 2570 generic.go:356] "Generic (PLEG): container finished" podID="1c4386e55f9cbe9814742507e478db6e" containerID="37ea9bc801a71f2918101d138c51acec26c14b1841b0b2099393fc1d70ff359d" exitCode=0 Jul 28 17:10:43.266209 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.265389 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" event={"ID":"1c4386e55f9cbe9814742507e478db6e","Type":"ContainerDied","Data":"37ea9bc801a71f2918101d138c51acec26c14b1841b0b2099393fc1d70ff359d"} Jul 28 17:10:43.278665 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.278595 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" event={"ID":"802e94b6ca2fdea2f3a6672231023aac","Type":"ContainerStarted","Data":"7099ac30c802c91d10a8480608bace63169ffd9d012f22dfa02c8ad40aa877d7"} Jul 28 17:10:43.289292 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.289164 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pvd2h" event={"ID":"e5234cca-d671-40ff-b9cd-e4e184221349","Type":"ContainerStarted","Data":"a1383b4b14bd1191deec44c55f80b65a21e0a0821e81236ead94c3cc00b01a1a"} Jul 28 17:10:43.299248 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.299212 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" event={"ID":"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5","Type":"ContainerStarted","Data":"1f1342513e9fda8394d4abb5f880573b06041313186ddb2aae6e06527094e3d3"} Jul 28 17:10:43.304495 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.304441 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-178.ec2.internal" podStartSLOduration=2.304420973 podStartE2EDuration="2.304420973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:43.303479657 +0000 UTC m=+4.651360609" watchObservedRunningTime="2026-07-28 17:10:43.304420973 +0000 UTC m=+4.652301910" Jul 28 17:10:43.325067 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.324757 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lldlc" event={"ID":"06ba6b63-6e18-4226-b614-cd94fb74026a","Type":"ContainerStarted","Data":"011f8b7764958c4dfee62b8e372d93530b706fdc803296bffbc8a428b8b5085c"} Jul 28 17:10:43.329205 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:43.329121 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n7mrd" event={"ID":"af54ed7f-261b-4812-9c63-0ec01331f266","Type":"ContainerStarted","Data":"d0ba0b501f3f355d921eb7d0872d47695ba7aa3bd2d2321876957f8f46509bbb"} Jul 28 17:10:44.221039 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:44.220438 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:44.221039 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.220605 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:44.349614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:44.349576 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" event={"ID":"1c4386e55f9cbe9814742507e478db6e","Type":"ContainerStarted","Data":"bc5f94e3e92e410caf33699aac3120e1a209f66296c10a078f5c26a9e84bfe89"} Jul 28 17:10:44.373080 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:44.373011 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-178.ec2.internal" podStartSLOduration=3.3729488610000002 podStartE2EDuration="3.372948861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:44.372715771 +0000 UTC m=+5.720596708" watchObservedRunningTime="2026-07-28 17:10:44.372948861 +0000 UTC m=+5.720829796" Jul 28 17:10:44.679618 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:44.678929 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:44.679618 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.679153 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:44.679618 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.679220 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs podName:e94fa4fc-230d-4bca-91da-de6bae60cb56 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:48.679200231 +0000 UTC m=+10.027081164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs") pod "network-metrics-daemon-bbztf" (UID: "e94fa4fc-230d-4bca-91da-de6bae60cb56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:44.781074 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:44.780397 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:44.781074 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.780558 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:44.781074 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.780622 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret podName:58620e3a-8378-46e5-9d7a-aaf8e78edf6b nodeName:}" failed. No retries permitted until 2026-07-28 17:10:48.780603278 +0000 UTC m=+10.128484195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret") pod "global-pull-secret-syncer-227qv" (UID: "58620e3a-8378-46e5-9d7a-aaf8e78edf6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:44.882575 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:44.881754 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:44.882575 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.881982 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:10:44.882575 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.882008 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:10:44.882575 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.882022 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fcz22 for pod openshift-network-diagnostics/network-check-target-mlskw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:44.882575 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:44.882084 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22 podName:2b9c67ba-8430-44b2-8779-aa136c0c6f17 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:48.882064618 +0000 UTC m=+10.229945528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcz22" (UniqueName: "kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22") pod "network-check-target-mlskw" (UID: "2b9c67ba-8430-44b2-8779-aa136c0c6f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:45.219992 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:45.219958 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:45.220203 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:45.220107 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:45.220573 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:45.220542 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:45.220686 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:45.220663 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:46.220260 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:46.220215 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:46.220811 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:46.220377 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:47.221043 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:47.220959 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:47.221043 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:47.221006 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:47.221631 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:47.221121 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:47.221631 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:47.221273 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:48.220154 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:48.220114 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:48.220361 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.220255 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:48.714714 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:48.714678 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:48.715122 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.714876 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:48.715122 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.714958 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs podName:e94fa4fc-230d-4bca-91da-de6bae60cb56 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:56.714936627 +0000 UTC m=+18.062817547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs") pod "network-metrics-daemon-bbztf" (UID: "e94fa4fc-230d-4bca-91da-de6bae60cb56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:48.815689 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:48.815648 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:48.815898 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.815835 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:48.815968 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.815901 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret podName:58620e3a-8378-46e5-9d7a-aaf8e78edf6b nodeName:}" failed. No retries permitted until 2026-07-28 17:10:56.815878314 +0000 UTC m=+18.163759227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret") pod "global-pull-secret-syncer-227qv" (UID: "58620e3a-8378-46e5-9d7a-aaf8e78edf6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:48.917200 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:48.917040 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:48.917390 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.917259 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:10:48.917390 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.917282 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:10:48.917390 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.917295 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fcz22 for pod openshift-network-diagnostics/network-check-target-mlskw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:48.917390 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:48.917358 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22 podName:2b9c67ba-8430-44b2-8779-aa136c0c6f17 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:56.917341057 +0000 UTC m=+18.265221967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcz22" (UniqueName: "kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22") pod "network-check-target-mlskw" (UID: "2b9c67ba-8430-44b2-8779-aa136c0c6f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:49.221646 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:49.221614 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:49.221858 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:49.221740 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:49.222226 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:49.222196 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:49.222363 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:49.222343 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:50.220544 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:50.220424 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:50.221036 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:50.220557 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:51.220517 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:51.220485 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:51.220684 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:51.220623 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:51.221080 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:51.221028 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:51.221177 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:51.221132 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:52.220146 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:52.220112 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:52.220343 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:52.220237 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:53.220250 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:53.220168 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:53.220669 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:53.220172 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:53.220669 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:53.220300 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:53.220669 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:53.220403 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:54.220596 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:54.220555 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:54.221094 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:54.221064 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:55.220550 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:55.220514 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:55.220727 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:55.220640 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:55.220727 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:55.220670 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:55.221173 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:55.220792 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:56.220317 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:56.220276 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:56.220567 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.220406 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:56.778745 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:56.778653 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:56.779144 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.778811 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:56.779144 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.778878 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs podName:e94fa4fc-230d-4bca-91da-de6bae60cb56 nodeName:}" failed. No retries permitted until 2026-07-28 17:11:12.778857089 +0000 UTC m=+34.126737999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs") pod "network-metrics-daemon-bbztf" (UID: "e94fa4fc-230d-4bca-91da-de6bae60cb56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:56.879757 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:56.879721 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:56.879942 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.879879 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:56.879991 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.879944 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret podName:58620e3a-8378-46e5-9d7a-aaf8e78edf6b nodeName:}" failed. No retries permitted until 2026-07-28 17:11:12.879924969 +0000 UTC m=+34.227805883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret") pod "global-pull-secret-syncer-227qv" (UID: "58620e3a-8378-46e5-9d7a-aaf8e78edf6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:56.980330 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:56.980290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:56.980503 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.980479 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:10:56.980559 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.980509 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:10:56.980559 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.980519 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fcz22 for pod openshift-network-diagnostics/network-check-target-mlskw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:56.980633 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:56.980574 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22 podName:2b9c67ba-8430-44b2-8779-aa136c0c6f17 nodeName:}" failed. No retries permitted until 2026-07-28 17:11:12.980560032 +0000 UTC m=+34.328440941 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcz22" (UniqueName: "kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22") pod "network-check-target-mlskw" (UID: "2b9c67ba-8430-44b2-8779-aa136c0c6f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:57.220160 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:57.220123 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:57.220345 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:57.220123 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:57.220345 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:57.220259 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:10:57.220345 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:57.220335 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:58.219878 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:58.219837 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:10:58.220328 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:58.219970 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:10:59.220909 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:59.220858 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:10:59.221370 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:10:59.220875 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:10:59.221370 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:59.220992 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:10:59.221370 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:10:59.221089 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:00.219690 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:00.219656 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:00.219869 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:00.219781 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:01.220603 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.220296 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:01.221382 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.220351 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:01.221382 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:01.220701 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:01.221382 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:01.220759 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:01.391823 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.391738 2570 generic.go:356] "Generic (PLEG): container finished" podID="19a27f5c-91b5-4084-85b4-7458623dc52a" containerID="92103717dd7cf362d550ebe610fd47314b7598f8b0894be29ae5b192cb13f2ed" exitCode=0 Jul 28 17:11:01.392004 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.391857 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" event={"ID":"19a27f5c-91b5-4084-85b4-7458623dc52a","Type":"ContainerDied","Data":"92103717dd7cf362d550ebe610fd47314b7598f8b0894be29ae5b192cb13f2ed"} Jul 28 17:11:01.393629 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.393599 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kb9wj" event={"ID":"d3113a92-c6d2-46c4-99fe-94d1e5bb6fab","Type":"ContainerStarted","Data":"c4bce0faf8729b9e632e829867b2d11c585a6a06f7eec72bd93a6c458d3665d3"} Jul 28 17:11:01.395731 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.395677 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" event={"ID":"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5","Type":"ContainerStarted","Data":"7bd4311859e821a6a6f93d18d67659415f5af7444a83324bd750452e87e462e8"} Jul 28 17:11:01.397229 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.397191 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lldlc" event={"ID":"06ba6b63-6e18-4226-b614-cd94fb74026a","Type":"ContainerStarted","Data":"52fb838921f2a53bc714021948e9c49d36b8be47e43eac98a8a6158e802b2b9d"} Jul 28 17:11:01.398759 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.398728 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n7mrd" event={"ID":"af54ed7f-261b-4812-9c63-0ec01331f266","Type":"ContainerStarted","Data":"2e4ec3dac023829c392d757fc4c605ecee4b9f5a8110bd30818d8b1d7dc0005f"} Jul 28 17:11:01.400374 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.400346 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqt2f" event={"ID":"e867cc7b-e212-4f81-b221-c346948ec4a0","Type":"ContainerStarted","Data":"46c930ff00b551cc36e42e932450c1a6401374b9d19ed36300d4e572842813ed"} Jul 28 17:11:01.404609 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.404583 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"63e578fe38db432c0c0188790a54d09323b16f0581937445ec9059aecc9559e4"} Jul 28 17:11:01.404706 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.404663 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"187ec175c673f6aa9eba092c9bfbe93f2e832874a062c89bcda08f6410125673"} Jul 28 17:11:01.404768 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.404712 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"9cf35a88b87e240d0a6983650f728b7e6d7a0431fb52807c367caa76ea91e8d9"} Jul 28 17:11:01.404768 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.404759 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"bd77ff90baad12be9741c6c072207f9b24eeb8cc06ba5f0efbb182b16e45b7c8"} Jul 28 17:11:01.404871 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.404819 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"ff3d347e49f876bb2a13e82af7c011de966e2654981a98ee89c00e40c28fdb02"} Jul 28 17:11:01.404871 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.404865 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"6ea17a57f0918fa1a064f7cef823b489ca2a0351926d00f710c96210e63ed545"} Jul 28 17:11:01.406341 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.406323 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tvjwr" event={"ID":"aa48fe6a-6d93-4b17-b269-4e26f1d11c05","Type":"ContainerStarted","Data":"316e94211b4288d51d7e8d5bb99223c28cd517f9cf4fcc9ccb797412ba869d6c"} Jul 28 17:11:01.440740 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.440691 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n7mrd" podStartSLOduration=4.217971001 podStartE2EDuration="22.440676149s" totalImagesPullingTime="18.222705148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:01.439907415 +0000 UTC m=+22.787788345" watchObservedRunningTime="2026-07-28 17:11:01.440676149 +0000 UTC m=+22.788557080" Jul 28 17:11:01.474284 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.474226 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tvjwr" podStartSLOduration=4.242946304 podStartE2EDuration="22.474207495s" totalImagesPullingTime="18.231261191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:01.474058174 +0000 UTC m=+22.821939106" watchObservedRunningTime="2026-07-28 17:11:01.474207495 +0000 UTC m=+22.822088428" Jul 28 17:11:01.474751 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.474718 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kb9wj" podStartSLOduration=8.21653753 podStartE2EDuration="22.47470793s" totalImagesPullingTime="14.2581704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:01.456376525 +0000 UTC m=+22.804257456" watchObservedRunningTime="2026-07-28 17:11:01.47470793 +0000 UTC m=+22.822588862" Jul 28 17:11:01.495845 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.495775 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cqt2f" podStartSLOduration=4.211097348 podStartE2EDuration="22.495754361s" totalImagesPullingTime="18.284657013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:01.495358836 +0000 UTC m=+22.843239766" watchObservedRunningTime="2026-07-28 17:11:01.495754361 +0000 UTC m=+22.843635293" Jul 28 17:11:01.515214 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.515156 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lldlc" podStartSLOduration=4.276502011 podStartE2EDuration="22.515139938s" totalImagesPullingTime="18.238637927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:01.514518954 +0000 UTC m=+22.862399885" watchObservedRunningTime="2026-07-28 17:11:01.515139938 +0000 UTC m=+22.863020883" Jul 28 17:11:01.678315 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.678274 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:01.778106 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:01.778069 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:02.162227 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.162198 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 17:11:02.219906 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.219878 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:02.220099 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:02.219995 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:02.410855 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.410817 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" event={"ID":"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5","Type":"ContainerStarted","Data":"7382d5a084fed7c3bbe3e896ff9f03f085b80b17d6a51bc2f882e92520e43eb6"} Jul 28 17:11:02.412404 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.412377 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pvd2h" event={"ID":"e5234cca-d671-40ff-b9cd-e4e184221349","Type":"ContainerStarted","Data":"55463ec9d7b005443ec002080f1a0874979ced142ceed0bb328b7901b2f1fb9a"} Jul 28 17:11:02.428523 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.428474 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pvd2h" podStartSLOduration=9.179294615 podStartE2EDuration="23.428460167s" totalImagesPullingTime="14.249165552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:02.427924809 +0000 UTC m=+23.775805741" watchObservedRunningTime="2026-07-28 17:11:02.428460167 +0000 UTC m=+23.776341098" Jul 28 17:11:02.544491 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.544463 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:11:02.545094 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.545073 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:11:02.550343 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.550314 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:02.667322 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:02.667245 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:03.098886 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.098738 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:11:02.162218352Z","UUID":"637124da-52b4-48a5-8b74-eff9b7ef7801","Handler":null,"Name":"","Endpoint":""} Jul 28 17:11:03.100485 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.100465 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 17:11:03.100485 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.100493 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 17:11:03.219828 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.219633 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:03.219828 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.219674 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:03.219828 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:03.219772 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:03.220103 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:03.219937 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:03.235305 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.235271 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:03.418670 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.418596 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"dcacebe47a9ebdece124042e74a1882e373dbe6b2563808231b4a813b09fbe82"} Jul 28 17:11:03.419131 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.418943 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:11:03.419487 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.419471 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kb9wj" Jul 28 17:11:03.487199 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.487166 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:03.950426 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:03.950388 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:04.019080 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:04.019048 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:04.088759 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:04.088591 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:04.220579 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:04.220499 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:04.220743 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:04.220617 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:04.425665 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:04.425629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" event={"ID":"a9ab28fe-8bec-4971-a1d6-eeaed4d614d5","Type":"ContainerStarted","Data":"71969460a22d0f10f539c4c4aa2dce77f8553d58fc828b8a46c635c6d82ad743"} Jul 28 17:11:04.447595 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:04.447547 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vk7k8" podStartSLOduration=4.546679468 podStartE2EDuration="25.447532397s" totalImagesPullingTime="20.900852929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:04.44704132 +0000 UTC m=+25.794922266" watchObservedRunningTime="2026-07-28 17:11:04.447532397 +0000 UTC m=+25.795413328" Jul 28 17:11:05.220203 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:05.220169 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:05.220402 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:05.220169 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:05.220402 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:05.220308 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:05.220402 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:05.220374 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:05.267499 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:05.267470 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:05.334088 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:05.334057 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:05.536092 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:05.536009 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:05.636957 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:05.636934 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:05.999496 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:05.999321 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:06.099910 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.099884 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:06.220263 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.220230 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:06.220409 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:06.220320 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:06.299179 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.299150 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:06.403021 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.402942 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:06.432972 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.432940 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" event={"ID":"aacd0446-d9ac-4f0a-be87-d48f388d24d8","Type":"ContainerStarted","Data":"b14b3ab1397924c8d20aca818cd78862e3255efa66b18a7acfae555036d02dfe"} Jul 28 17:11:06.433206 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.433189 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:11:06.433359 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.433334 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:11:06.433465 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.433406 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:11:06.434787 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.434763 2570 generic.go:356] "Generic (PLEG): container finished" podID="19a27f5c-91b5-4084-85b4-7458623dc52a" containerID="f634588e6383da570868aa0cb67f5d97acbefecb901e331a58899128dbb4c67c" exitCode=0 Jul 28 17:11:06.434889 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.434820 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" event={"ID":"19a27f5c-91b5-4084-85b4-7458623dc52a","Type":"ContainerDied","Data":"f634588e6383da570868aa0cb67f5d97acbefecb901e331a58899128dbb4c67c"} Jul 28 17:11:06.448500 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.448477 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:11:06.452178 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.452163 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:11:06.466772 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:06.466725 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" podStartSLOduration=9.175513844 podStartE2EDuration="27.466710466s" totalImagesPullingTime="18.291196622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:06.466126748 +0000 UTC m=+27.814007679" watchObservedRunningTime="2026-07-28 17:11:06.466710466 +0000 UTC m=+27.814591395" Jul 28 17:11:07.220097 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:07.220066 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:07.220675 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:07.220068 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:07.220675 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:07.220175 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:07.220675 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:07.220245 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:07.799552 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:07.799462 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-227qv"] Jul 28 17:11:07.799849 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:07.799559 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:07.799849 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:07.799632 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:07.808267 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:07.808241 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mlskw"] Jul 28 17:11:07.808387 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:07.808345 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:07.808449 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:07.808428 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:07.808903 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:07.808880 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bbztf"] Jul 28 17:11:07.808995 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:07.808962 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:07.809062 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:07.809035 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:08.441247 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:08.441217 2570 generic.go:356] "Generic (PLEG): container finished" podID="19a27f5c-91b5-4084-85b4-7458623dc52a" containerID="6e9cca72eb8ddbf002b8142a1c2abfe93f7d43029646ab62fe68ad25388da03b" exitCode=0 Jul 28 17:11:08.441596 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:08.441308 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" event={"ID":"19a27f5c-91b5-4084-85b4-7458623dc52a","Type":"ContainerDied","Data":"6e9cca72eb8ddbf002b8142a1c2abfe93f7d43029646ab62fe68ad25388da03b"} Jul 28 17:11:09.221550 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:09.221348 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:09.221550 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:09.221454 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:09.221550 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:09.221454 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:09.221550 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:09.221538 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:10.220092 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:10.219915 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:10.220517 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:10.220179 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:10.447686 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:10.447648 2570 generic.go:356] "Generic (PLEG): container finished" podID="19a27f5c-91b5-4084-85b4-7458623dc52a" containerID="3257b2e536c30f96643def18c66529b8acc60159e54e2a902f32694bf08c701d" exitCode=0 Jul 28 17:11:10.447858 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:10.447697 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" event={"ID":"19a27f5c-91b5-4084-85b4-7458623dc52a","Type":"ContainerDied","Data":"3257b2e536c30f96643def18c66529b8acc60159e54e2a902f32694bf08c701d"} Jul 28 17:11:11.220009 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:11.219973 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:11.220009 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:11.220000 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:11.220529 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:11.220155 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:11.220529 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:11.220276 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:12.220222 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:12.220189 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:12.220850 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:12.220659 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:12.805614 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:12.805577 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:12.805840 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:12.805729 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:11:12.805840 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:12.805790 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs podName:e94fa4fc-230d-4bca-91da-de6bae60cb56 nodeName:}" failed. No retries permitted until 2026-07-28 17:11:44.805772934 +0000 UTC m=+66.153653858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs") pod "network-metrics-daemon-bbztf" (UID: "e94fa4fc-230d-4bca-91da-de6bae60cb56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:11:12.906477 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:12.906442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:12.906663 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:12.906577 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:11:12.906663 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:12.906637 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret podName:58620e3a-8378-46e5-9d7a-aaf8e78edf6b nodeName:}" failed. No retries permitted until 2026-07-28 17:11:44.906618423 +0000 UTC m=+66.254499336 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret") pod "global-pull-secret-syncer-227qv" (UID: "58620e3a-8378-46e5-9d7a-aaf8e78edf6b") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:11:13.007742 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:13.007706 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:13.007937 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:13.007865 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:11:13.007937 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:13.007887 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:11:13.007937 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:13.007899 2570 projected.go:196] Error preparing data for projected volume kube-api-access-fcz22 for pod openshift-network-diagnostics/network-check-target-mlskw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:11:13.008087 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:13.007956 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22 podName:2b9c67ba-8430-44b2-8779-aa136c0c6f17 nodeName:}" failed. No retries permitted until 2026-07-28 17:11:45.007938655 +0000 UTC m=+66.355819565 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcz22" (UniqueName: "kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22") pod "network-check-target-mlskw" (UID: "2b9c67ba-8430-44b2-8779-aa136c0c6f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:11:13.219981 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:13.219942 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:13.219981 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:13.219965 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:13.220211 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:13.220078 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:13.220211 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:13.220165 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:14.220546 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:14.220513 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:14.220980 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:14.220630 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:15.220058 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:15.220019 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:15.220224 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:15.220141 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:15.220224 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:15.220201 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:15.220330 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:15.220308 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:15.462971 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:15.462939 2570 generic.go:356] "Generic (PLEG): container finished" podID="19a27f5c-91b5-4084-85b4-7458623dc52a" containerID="768a831edaecee1a0036222b5fa011ee46e5b6d545b179ebbe0d45a6641d1bda" exitCode=0 Jul 28 17:11:15.463442 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:15.462988 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" event={"ID":"19a27f5c-91b5-4084-85b4-7458623dc52a","Type":"ContainerDied","Data":"768a831edaecee1a0036222b5fa011ee46e5b6d545b179ebbe0d45a6641d1bda"} Jul 28 17:11:16.219914 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:16.219886 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:16.220057 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:16.219996 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:16.467930 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:16.467902 2570 generic.go:356] "Generic (PLEG): container finished" podID="19a27f5c-91b5-4084-85b4-7458623dc52a" containerID="249df29612402dd5e1d4066bd6256560aa40d6529c87b5a9495b392cc5530272" exitCode=0 Jul 28 17:11:16.468396 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:16.467941 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" event={"ID":"19a27f5c-91b5-4084-85b4-7458623dc52a","Type":"ContainerDied","Data":"249df29612402dd5e1d4066bd6256560aa40d6529c87b5a9495b392cc5530272"} Jul 28 17:11:17.220152 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:17.220115 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:17.220319 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:17.220162 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:17.220319 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:17.220249 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:17.220393 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:17.220345 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:17.473567 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:17.473482 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" event={"ID":"19a27f5c-91b5-4084-85b4-7458623dc52a","Type":"ContainerStarted","Data":"6b214f39256d21e9f8cbb4d0e8647cdc1417adacca1762386c7c52260ab68e2b"} Jul 28 17:11:17.497703 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:17.497656 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vfbgc" podStartSLOduration=8.601126073 podStartE2EDuration="37.497640625s" totalImagesPullingTime="28.896514552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:17.496413094 +0000 UTC m=+38.844294023" watchObservedRunningTime="2026-07-28 17:11:17.497640625 +0000 UTC m=+38.845521555" Jul 28 17:11:18.220293 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:18.220118 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:18.220460 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:18.220370 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:19.221445 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:19.221414 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:19.221782 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:19.221497 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:19.221782 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:19.221593 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:19.221782 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:19.221687 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:20.220272 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:20.220245 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:20.220435 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:20.220347 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:21.220560 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:21.220526 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:21.220983 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:21.220636 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:21.220983 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:21.220689 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:21.220983 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:21.220769 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:22.220410 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:22.220372 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:22.220576 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:22.220481 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:23.220588 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:23.220557 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:23.220987 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:23.220560 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:23.220987 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:23.220671 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:23.220987 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:23.220721 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:24.220060 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:24.220025 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:24.220294 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:24.220138 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:25.220188 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:25.220153 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:25.220564 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:25.220153 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:25.220564 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:25.220263 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:25.220564 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:25.220336 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:26.220555 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:26.220519 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:26.220963 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:26.220636 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:27.219951 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:27.219915 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:27.220119 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:27.220023 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:27.220119 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:27.220075 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:27.220194 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:27.220155 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:28.220533 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:28.220501 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:28.220916 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:28.220600 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:29.223350 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:29.223324 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:29.223714 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:29.223324 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:29.223714 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:29.223411 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:29.223714 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:29.223481 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:30.220461 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:30.220429 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:30.220635 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:30.220539 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbztf" podUID="e94fa4fc-230d-4bca-91da-de6bae60cb56" Jul 28 17:11:31.220432 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.220347 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:31.220779 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:31.220501 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-227qv" podUID="58620e3a-8378-46e5-9d7a-aaf8e78edf6b" Jul 28 17:11:31.220779 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.220537 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:31.220779 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:31.220642 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlskw" podUID="2b9c67ba-8430-44b2-8779-aa136c0c6f17" Jul 28 17:11:31.462556 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.462529 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-178.ec2.internal" event="NodeReady" Jul 28 17:11:31.462719 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.462659 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 17:11:31.500332 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.500261 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dc7b9d64d-c24wq"] Jul 28 17:11:31.521794 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.521765 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8hvvq"] Jul 28 17:11:31.521953 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.521910 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.524770 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.524743 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 17:11:31.524919 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.524864 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 17:11:31.525107 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.525088 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-49wd2\"" Jul 28 17:11:31.525220 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.525206 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 17:11:31.531134 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.531117 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 17:11:31.545669 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.545647 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dc7b9d64d-c24wq"] Jul 28 17:11:31.545830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.545679 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qsffg"] Jul 28 17:11:31.545830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.545779 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.548008 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.547986 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-image-registry-private-configuration\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.548109 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548022 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2gst\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-kube-api-access-x2gst\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.548109 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-ca-trust-extracted\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.548109 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-bound-sa-token\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.548267 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548166 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-registry-certificates\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.548267 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548199 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-installation-pull-secrets\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.548267 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548228 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6mf7\"" Jul 28 17:11:31.548400 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548266 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-trusted-ca\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.548400 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548308 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-registry-tls\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.548400 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548361 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 17:11:31.548510 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.548482 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 17:11:31.569796 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.569764 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8hvvq"] Jul 28 17:11:31.569796 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.569815 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qsffg"] Jul 28 17:11:31.569993 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.569907 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.574253 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.574233 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 17:11:31.574367 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.574316 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 17:11:31.574497 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.574477 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 17:11:31.574878 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.574857 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6z7jm\"" Jul 28 17:11:31.575042 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.574943 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 17:11:31.616634 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.616601 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2shdc"] Jul 28 17:11:31.639977 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.639952 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2shdc"] Jul 28 17:11:31.640116 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.640045 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2shdc" Jul 28 17:11:31.643770 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.643750 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 17:11:31.643930 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.643775 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 17:11:31.643930 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.643795 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ncgbp\"" Jul 28 17:11:31.644038 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.644025 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 17:11:31.649456 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649439 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-ca-trust-extracted\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.649590 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649468 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1776fe27-b08e-47be-a86f-b033fc89f81a-tmp-dir\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.649590 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-bound-sa-token\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.649714 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649603 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6bf4e1c-2ab0-4648-b148-e28cfc944537-crio-socket\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.649714 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649659 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6bf4e1c-2ab0-4648-b148-e28cfc944537-data-volume\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.649714 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649704 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-registry-certificates\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.649924 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-installation-pull-secrets\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.649924 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649733 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-ca-trust-extracted\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.649924 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649759 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1776fe27-b08e-47be-a86f-b033fc89f81a-config-volume\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.649924 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6bf4e1c-2ab0-4648-b148-e28cfc944537-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.649924 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-trusted-ca\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.649924 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1776fe27-b08e-47be-a86f-b033fc89f81a-metrics-tls\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.650201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649938 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-registry-tls\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.650201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649963 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6bf4e1c-2ab0-4648-b148-e28cfc944537-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.650201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.649988 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk7w9\" (UniqueName: \"kubernetes.io/projected/d6bf4e1c-2ab0-4648-b148-e28cfc944537-kube-api-access-gk7w9\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.650201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.650015 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-image-registry-private-configuration\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.650201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.650086 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2gst\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-kube-api-access-x2gst\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.650201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.650112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcnrn\" (UniqueName: \"kubernetes.io/projected/1776fe27-b08e-47be-a86f-b033fc89f81a-kube-api-access-tcnrn\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.650529 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.650504 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-registry-certificates\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.650951 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.650776 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-trusted-ca\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.654606 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.654579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-installation-pull-secrets\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.654712 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.654604 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-image-registry-private-configuration\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.654769 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.654729 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-registry-tls\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.658174 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.658151 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-bound-sa-token\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.658284 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.658260 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2gst\" (UniqueName: \"kubernetes.io/projected/9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43-kube-api-access-x2gst\") pod \"image-registry-6dc7b9d64d-c24wq\" (UID: \"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43\") " pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.750927 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.750829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1776fe27-b08e-47be-a86f-b033fc89f81a-tmp-dir\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.750927 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.750874 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6bf4e1c-2ab0-4648-b148-e28cfc944537-crio-socket\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.750927 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.750898 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6bf4e1c-2ab0-4648-b148-e28cfc944537-data-volume\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.750927 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.750916 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5acd1fa5-910f-4598-8344-5808f48f1cca-cert\") pod \"ingress-canary-2shdc\" (UID: \"5acd1fa5-910f-4598-8344-5808f48f1cca\") " pod="openshift-ingress-canary/ingress-canary-2shdc" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.750937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1776fe27-b08e-47be-a86f-b033fc89f81a-config-volume\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.750947 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6bf4e1c-2ab0-4648-b148-e28cfc944537-crio-socket\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.750960 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6bf4e1c-2ab0-4648-b148-e28cfc944537-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751007 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1776fe27-b08e-47be-a86f-b033fc89f81a-metrics-tls\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6bf4e1c-2ab0-4648-b148-e28cfc944537-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk7w9\" (UniqueName: \"kubernetes.io/projected/d6bf4e1c-2ab0-4648-b148-e28cfc944537-kube-api-access-gk7w9\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751073 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psq6t\" (UniqueName: \"kubernetes.io/projected/5acd1fa5-910f-4598-8344-5808f48f1cca-kube-api-access-psq6t\") pod \"ingress-canary-2shdc\" (UID: \"5acd1fa5-910f-4598-8344-5808f48f1cca\") " pod="openshift-ingress-canary/ingress-canary-2shdc" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751102 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcnrn\" (UniqueName: \"kubernetes.io/projected/1776fe27-b08e-47be-a86f-b033fc89f81a-kube-api-access-tcnrn\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.751231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751226 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1776fe27-b08e-47be-a86f-b033fc89f81a-tmp-dir\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.751633 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751375 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6bf4e1c-2ab0-4648-b148-e28cfc944537-data-volume\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.751633 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751542 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6bf4e1c-2ab0-4648-b148-e28cfc944537-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.751633 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.751553 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1776fe27-b08e-47be-a86f-b033fc89f81a-config-volume\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.753424 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.753406 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1776fe27-b08e-47be-a86f-b033fc89f81a-metrics-tls\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.753556 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.753535 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6bf4e1c-2ab0-4648-b148-e28cfc944537-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.759870 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.759791 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcnrn\" (UniqueName: \"kubernetes.io/projected/1776fe27-b08e-47be-a86f-b033fc89f81a-kube-api-access-tcnrn\") pod \"dns-default-8hvvq\" (UID: \"1776fe27-b08e-47be-a86f-b033fc89f81a\") " pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.760076 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.760057 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk7w9\" (UniqueName: \"kubernetes.io/projected/d6bf4e1c-2ab0-4648-b148-e28cfc944537-kube-api-access-gk7w9\") pod \"insights-runtime-extractor-qsffg\" (UID: \"d6bf4e1c-2ab0-4648-b148-e28cfc944537\") " pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.831084 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.831054 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:31.851544 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.851515 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5acd1fa5-910f-4598-8344-5808f48f1cca-cert\") pod \"ingress-canary-2shdc\" (UID: \"5acd1fa5-910f-4598-8344-5808f48f1cca\") " pod="openshift-ingress-canary/ingress-canary-2shdc" Jul 28 17:11:31.851648 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.851616 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psq6t\" (UniqueName: \"kubernetes.io/projected/5acd1fa5-910f-4598-8344-5808f48f1cca-kube-api-access-psq6t\") pod \"ingress-canary-2shdc\" (UID: \"5acd1fa5-910f-4598-8344-5808f48f1cca\") " pod="openshift-ingress-canary/ingress-canary-2shdc" Jul 28 17:11:31.853785 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.853759 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5acd1fa5-910f-4598-8344-5808f48f1cca-cert\") pod \"ingress-canary-2shdc\" (UID: \"5acd1fa5-910f-4598-8344-5808f48f1cca\") " pod="openshift-ingress-canary/ingress-canary-2shdc" Jul 28 17:11:31.853902 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.853887 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:31.860440 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.860421 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psq6t\" (UniqueName: \"kubernetes.io/projected/5acd1fa5-910f-4598-8344-5808f48f1cca-kube-api-access-psq6t\") pod \"ingress-canary-2shdc\" (UID: \"5acd1fa5-910f-4598-8344-5808f48f1cca\") " pod="openshift-ingress-canary/ingress-canary-2shdc" Jul 28 17:11:31.878158 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.878137 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qsffg" Jul 28 17:11:31.948379 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:31.948193 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2shdc" Jul 28 17:11:32.055627 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.055375 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8hvvq"] Jul 28 17:11:32.075910 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:32.075681 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1776fe27_b08e_47be_a86f_b033fc89f81a.slice/crio-e337f56c44f891c2a92fc1f1044742b1408a5a8e3cb63327a2f7892ec87a825f WatchSource:0}: Error finding container e337f56c44f891c2a92fc1f1044742b1408a5a8e3cb63327a2f7892ec87a825f: Status 404 returned error can't find the container with id e337f56c44f891c2a92fc1f1044742b1408a5a8e3cb63327a2f7892ec87a825f Jul 28 17:11:32.077157 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.077090 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dc7b9d64d-c24wq"] Jul 28 17:11:32.080362 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:32.080327 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca7b17f_0ab9_4870_8d72_3c7aaf0a0f43.slice/crio-8213dce55935e8a5ef4e0339050b7c2274fb36018da89321b21729eef62b1237 WatchSource:0}: Error finding container 8213dce55935e8a5ef4e0339050b7c2274fb36018da89321b21729eef62b1237: Status 404 returned error can't find the container with id 8213dce55935e8a5ef4e0339050b7c2274fb36018da89321b21729eef62b1237 Jul 28 17:11:32.089605 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.089585 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qsffg"] Jul 28 17:11:32.107150 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:32.107116 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6bf4e1c_2ab0_4648_b148_e28cfc944537.slice/crio-d54af1d9d5d50c7dcf2c72cc6a0fe1f52c5218a38805492a77d59fdbc16071f5 WatchSource:0}: Error finding container d54af1d9d5d50c7dcf2c72cc6a0fe1f52c5218a38805492a77d59fdbc16071f5: Status 404 returned error can't find the container with id d54af1d9d5d50c7dcf2c72cc6a0fe1f52c5218a38805492a77d59fdbc16071f5 Jul 28 17:11:32.139013 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.138986 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2shdc"] Jul 28 17:11:32.142345 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:32.142324 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5acd1fa5_910f_4598_8344_5808f48f1cca.slice/crio-c268f8eaee5d0b11cd820255e946b79ae2e8013d07c88f482a35a0d7e21a9067 WatchSource:0}: Error finding container c268f8eaee5d0b11cd820255e946b79ae2e8013d07c88f482a35a0d7e21a9067: Status 404 returned error can't find the container with id c268f8eaee5d0b11cd820255e946b79ae2e8013d07c88f482a35a0d7e21a9067 Jul 28 17:11:32.219699 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.219670 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:32.222516 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.222496 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:11:32.222817 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.222496 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jtwlq\"" Jul 28 17:11:32.507069 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.507032 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2shdc" event={"ID":"5acd1fa5-910f-4598-8344-5808f48f1cca","Type":"ContainerStarted","Data":"c268f8eaee5d0b11cd820255e946b79ae2e8013d07c88f482a35a0d7e21a9067"} Jul 28 17:11:32.508125 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.508105 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qsffg" event={"ID":"d6bf4e1c-2ab0-4648-b148-e28cfc944537","Type":"ContainerStarted","Data":"d54af1d9d5d50c7dcf2c72cc6a0fe1f52c5218a38805492a77d59fdbc16071f5"} Jul 28 17:11:32.509253 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.509233 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8hvvq" event={"ID":"1776fe27-b08e-47be-a86f-b033fc89f81a","Type":"ContainerStarted","Data":"e337f56c44f891c2a92fc1f1044742b1408a5a8e3cb63327a2f7892ec87a825f"} Jul 28 17:11:32.510611 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.510592 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" event={"ID":"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43","Type":"ContainerStarted","Data":"979925e5380bcd204fe986ee6f06e237b27e8d36021f5b54c200b088adfe4d02"} Jul 28 17:11:32.510699 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.510631 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" event={"ID":"9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43","Type":"ContainerStarted","Data":"8213dce55935e8a5ef4e0339050b7c2274fb36018da89321b21729eef62b1237"} Jul 28 17:11:32.510747 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.510729 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:32.534215 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:32.534083 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" podStartSLOduration=2.534065584 podStartE2EDuration="2.534065584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:32.532820404 +0000 UTC m=+53.880701329" watchObservedRunningTime="2026-07-28 17:11:32.534065584 +0000 UTC m=+53.881946516" Jul 28 17:11:33.220689 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:33.220430 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:33.220689 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:33.220633 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:33.223564 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:33.223537 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:11:33.223937 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:33.223599 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:11:33.225091 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:33.224890 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-phqg2\"" Jul 28 17:11:33.225091 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:33.224921 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:11:34.518039 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:34.517992 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8hvvq" event={"ID":"1776fe27-b08e-47be-a86f-b033fc89f81a","Type":"ContainerStarted","Data":"d6bbdcf0c1d4f08d3dcf18ac7505b0f6fa36a218b14de533662a511fda5062d2"} Jul 28 17:11:37.530270 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:37.530078 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:37.549599 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:37.549535 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8hvvq" podStartSLOduration=4.539352484 podStartE2EDuration="6.54940892s" totalImagesPullingTime="2.010056436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:37.548754811 +0000 UTC m=+58.896635743" watchObservedRunningTime="2026-07-28 17:11:37.54940892 +0000 UTC m=+58.897289850" Jul 28 17:11:38.453774 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:38.453748 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnt2g" Jul 28 17:11:38.536416 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:38.536363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2shdc" event={"ID":"5acd1fa5-910f-4598-8344-5808f48f1cca","Type":"ContainerStarted","Data":"723ee52ebf001f98b6105b992899c7c9449d1adf8058e36fb6a2fa0361da390d"} Jul 28 17:11:38.538204 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:38.538171 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qsffg" event={"ID":"d6bf4e1c-2ab0-4648-b148-e28cfc944537","Type":"ContainerStarted","Data":"6352217ae85c0739b49af906a2571589e84b26c1c18ac5956a539ef68b6453a3"} Jul 28 17:11:38.540062 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:38.540036 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8hvvq" event={"ID":"1776fe27-b08e-47be-a86f-b033fc89f81a","Type":"ContainerStarted","Data":"37602b19f68db3935e19e5a907795abb3687fd99870c80e31eaca93479db79fe"} Jul 28 17:11:38.555569 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:38.555513 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2shdc" podStartSLOduration=2.265761708 podStartE2EDuration="7.555490919s" totalImagesPullingTime="5.289729211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:38.554436736 +0000 UTC m=+59.902317671" watchObservedRunningTime="2026-07-28 17:11:38.555490919 +0000 UTC m=+59.903371848" Jul 28 17:11:41.550435 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:41.550387 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qsffg" event={"ID":"d6bf4e1c-2ab0-4648-b148-e28cfc944537","Type":"ContainerStarted","Data":"4e8c71781d97e66c8e8be4965d8d044cc6ad7daa73aeec662c8022067cc73558"} Jul 28 17:11:44.561760 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:44.561678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qsffg" event={"ID":"d6bf4e1c-2ab0-4648-b148-e28cfc944537","Type":"ContainerStarted","Data":"852d59a7356a165662107612c1b14fbed1a2d9b2d8a58d2562c65f7d1c853e28"} Jul 28 17:11:44.584902 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:44.584850 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qsffg" podStartSLOduration=1.54234062 podStartE2EDuration="13.584835238s" totalImagesPullingTime="12.042494618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:11:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:44.583777428 +0000 UTC m=+65.931658350" watchObservedRunningTime="2026-07-28 17:11:44.584835238 +0000 UTC m=+65.932716168" Jul 28 17:11:44.856086 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:44.856056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:44.858961 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:44.858942 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:11:44.868666 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:44.868642 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94fa4fc-230d-4bca-91da-de6bae60cb56-metrics-certs\") pod \"network-metrics-daemon-bbztf\" (UID: \"e94fa4fc-230d-4bca-91da-de6bae60cb56\") " pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:44.957383 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:44.957327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:44.960675 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:44.960657 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:11:44.969616 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:44.969595 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58620e3a-8378-46e5-9d7a-aaf8e78edf6b-original-pull-secret\") pod \"global-pull-secret-syncer-227qv\" (UID: \"58620e3a-8378-46e5-9d7a-aaf8e78edf6b\") " pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:45.058092 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.058045 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:45.064224 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.061583 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:11:45.070970 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.070944 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:11:45.081543 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.081511 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcz22\" (UniqueName: \"kubernetes.io/projected/2b9c67ba-8430-44b2-8779-aa136c0c6f17-kube-api-access-fcz22\") pod \"network-check-target-mlskw\" (UID: \"2b9c67ba-8430-44b2-8779-aa136c0c6f17\") " pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:45.130295 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.130224 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jtwlq\"" Jul 28 17:11:45.138622 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.138600 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbztf" Jul 28 17:11:45.236237 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.236209 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-227qv" Jul 28 17:11:45.249016 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.248995 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-phqg2\"" Jul 28 17:11:45.256297 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.256275 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:45.261037 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.261011 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bbztf"] Jul 28 17:11:45.263365 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:45.263338 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94fa4fc_230d_4bca_91da_de6bae60cb56.slice/crio-85ca73fc9bd01017acbdaa9b7db082ddb45f3cd0b8c11a526be7730365f6050f WatchSource:0}: Error finding container 85ca73fc9bd01017acbdaa9b7db082ddb45f3cd0b8c11a526be7730365f6050f: Status 404 returned error can't find the container with id 85ca73fc9bd01017acbdaa9b7db082ddb45f3cd0b8c11a526be7730365f6050f Jul 28 17:11:45.375352 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.375327 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-227qv"] Jul 28 17:11:45.377654 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:45.377626 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58620e3a_8378_46e5_9d7a_aaf8e78edf6b.slice/crio-f2fc3556d048b368dec7195c691316829ea61ce43a7c08d3e94a440b2bf83cb2 WatchSource:0}: Error finding container f2fc3556d048b368dec7195c691316829ea61ce43a7c08d3e94a440b2bf83cb2: Status 404 returned error can't find the container with id f2fc3556d048b368dec7195c691316829ea61ce43a7c08d3e94a440b2bf83cb2 Jul 28 17:11:45.394293 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.394267 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mlskw"] Jul 28 17:11:45.397354 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:45.397316 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9c67ba_8430_44b2_8779_aa136c0c6f17.slice/crio-1820b8742ee2f6f101cb8195a365fd8b9088803e9e73b5ba35a23c3b33d7d928 WatchSource:0}: Error finding container 1820b8742ee2f6f101cb8195a365fd8b9088803e9e73b5ba35a23c3b33d7d928: Status 404 returned error can't find the container with id 1820b8742ee2f6f101cb8195a365fd8b9088803e9e73b5ba35a23c3b33d7d928 Jul 28 17:11:45.545634 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.545605 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8hvvq" Jul 28 17:11:45.566588 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.566551 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bbztf" event={"ID":"e94fa4fc-230d-4bca-91da-de6bae60cb56","Type":"ContainerStarted","Data":"85ca73fc9bd01017acbdaa9b7db082ddb45f3cd0b8c11a526be7730365f6050f"} Jul 28 17:11:45.567639 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.567616 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mlskw" event={"ID":"2b9c67ba-8430-44b2-8779-aa136c0c6f17","Type":"ContainerStarted","Data":"1820b8742ee2f6f101cb8195a365fd8b9088803e9e73b5ba35a23c3b33d7d928"} Jul 28 17:11:45.568579 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:45.568561 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-227qv" event={"ID":"58620e3a-8378-46e5-9d7a-aaf8e78edf6b","Type":"ContainerStarted","Data":"f2fc3556d048b368dec7195c691316829ea61ce43a7c08d3e94a440b2bf83cb2"} Jul 28 17:11:47.580243 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:47.579904 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bbztf" event={"ID":"e94fa4fc-230d-4bca-91da-de6bae60cb56","Type":"ContainerStarted","Data":"2996844a3c3c074512198107726dcac99c88fabb43a6ec1d935efacaf858ae6e"} Jul 28 17:11:47.580243 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:47.579962 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bbztf" event={"ID":"e94fa4fc-230d-4bca-91da-de6bae60cb56","Type":"ContainerStarted","Data":"7a4806afa4262bdb3b85246644dc77ba265fb21e0e381f35cabccaa161cb8fa4"} Jul 28 17:11:47.601362 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:47.601302 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bbztf" podStartSLOduration=67.103505271 podStartE2EDuration="1m8.601279626s" totalImagesPullingTime="1.497774355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:47.601052407 +0000 UTC m=+68.948933364" watchObservedRunningTime="2026-07-28 17:11:47.601279626 +0000 UTC m=+68.949160591" Jul 28 17:11:49.978020 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.977977 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf"] Jul 28 17:11:49.980692 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.980674 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:49.986540 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.986516 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6t2zh\"" Jul 28 17:11:49.986670 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.986579 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 17:11:49.987172 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.987146 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 17:11:49.987765 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.987748 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 17:11:49.987875 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.987768 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 17:11:49.987875 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.987831 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 17:11:49.998740 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:49.998719 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf"] Jul 28 17:11:50.012001 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.011907 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6"] Jul 28 17:11:50.014310 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.014289 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.017459 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.017435 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 17:11:50.017591 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.017514 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 17:11:50.017591 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.017544 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k249z\"" Jul 28 17:11:50.017591 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.017577 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 17:11:50.021405 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.021383 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sxq6d"] Jul 28 17:11:50.026406 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.024205 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.027297 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.027275 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zrj4d\"" Jul 28 17:11:50.027571 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.027547 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 17:11:50.027819 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.027785 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 17:11:50.027900 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.027829 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 17:11:50.030654 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.030631 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6"] Jul 28 17:11:50.094036 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.093943 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-node-exporter-wtmp\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.094036 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.093988 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/299b3c56-73aa-46e5-88af-7d5a07736c5e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.094036 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094016 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrk5n\" (UniqueName: \"kubernetes.io/projected/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-api-access-nrk5n\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.094246 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094108 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/700cd7ae-3574-4191-a379-72b399377322-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.094246 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094141 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rvz\" (UniqueName: \"kubernetes.io/projected/700cd7ae-3574-4191-a379-72b399377322-kube-api-access-f4rvz\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.094246 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094162 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/700cd7ae-3574-4191-a379-72b399377322-node-exporter-textfile\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.094246 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/77210d4b-8a15-4440-8eb0-7e2f143dedd6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.094395 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094255 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np57q\" (UniqueName: \"kubernetes.io/projected/299b3c56-73aa-46e5-88af-7d5a07736c5e-kube-api-access-np57q\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.094395 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094277 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/299b3c56-73aa-46e5-88af-7d5a07736c5e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.094395 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094309 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.094395 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094340 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299b3c56-73aa-46e5-88af-7d5a07736c5e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.094395 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094366 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-sys\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.094395 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094387 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.094630 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094445 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-root\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.094630 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094462 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/700cd7ae-3574-4191-a379-72b399377322-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.094630 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094479 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77210d4b-8a15-4440-8eb0-7e2f143dedd6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.094630 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094496 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.094630 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094512 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/700cd7ae-3574-4191-a379-72b399377322-node-exporter-tls\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.094630 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.094528 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/700cd7ae-3574-4191-a379-72b399377322-metrics-client-ca\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.194992 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.194955 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/299b3c56-73aa-46e5-88af-7d5a07736c5e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.195162 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195011 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.195162 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195042 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299b3c56-73aa-46e5-88af-7d5a07736c5e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.195162 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195067 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-sys\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195162 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.195162 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195123 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-root\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195381 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195187 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-root\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195381 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195240 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-sys\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195381 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:50.195247 2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 28 17:11:50.195381 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/700cd7ae-3574-4191-a379-72b399377322-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195381 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195293 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77210d4b-8a15-4440-8eb0-7e2f143dedd6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.195381 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195319 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.195381 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:11:50.195355 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-tls podName:77210d4b-8a15-4440-8eb0-7e2f143dedd6 nodeName:}" failed. No retries permitted until 2026-07-28 17:11:50.695328401 +0000 UTC m=+72.043209311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-89gv6" (UID: "77210d4b-8a15-4440-8eb0-7e2f143dedd6") : secret "kube-state-metrics-tls" not found Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/700cd7ae-3574-4191-a379-72b399377322-node-exporter-tls\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195439 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/700cd7ae-3574-4191-a379-72b399377322-metrics-client-ca\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195466 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-node-exporter-wtmp\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195501 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/299b3c56-73aa-46e5-88af-7d5a07736c5e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195531 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrk5n\" (UniqueName: \"kubernetes.io/projected/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-api-access-nrk5n\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195583 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/700cd7ae-3574-4191-a379-72b399377322-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195606 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rvz\" (UniqueName: \"kubernetes.io/projected/700cd7ae-3574-4191-a379-72b399377322-kube-api-access-f4rvz\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195626 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/700cd7ae-3574-4191-a379-72b399377322-node-exporter-textfile\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195648 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/77210d4b-8a15-4440-8eb0-7e2f143dedd6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.195734 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195679 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np57q\" (UniqueName: \"kubernetes.io/projected/299b3c56-73aa-46e5-88af-7d5a07736c5e-kube-api-access-np57q\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.196229 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195902 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.196229 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.195911 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/700cd7ae-3574-4191-a379-72b399377322-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.196229 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.196034 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299b3c56-73aa-46e5-88af-7d5a07736c5e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.196229 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.196045 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/700cd7ae-3574-4191-a379-72b399377322-node-exporter-wtmp\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.196229 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.196188 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/700cd7ae-3574-4191-a379-72b399377322-node-exporter-textfile\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.196709 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.196684 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77210d4b-8a15-4440-8eb0-7e2f143dedd6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.196831 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.196714 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/77210d4b-8a15-4440-8eb0-7e2f143dedd6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.196903 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.196847 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/700cd7ae-3574-4191-a379-72b399377322-metrics-client-ca\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.198466 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.198440 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.198648 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.198627 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/299b3c56-73aa-46e5-88af-7d5a07736c5e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.198890 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.198869 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/700cd7ae-3574-4191-a379-72b399377322-node-exporter-tls\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.198955 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.198942 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/700cd7ae-3574-4191-a379-72b399377322-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.199008 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.198973 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/299b3c56-73aa-46e5-88af-7d5a07736c5e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.204719 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.204694 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np57q\" (UniqueName: \"kubernetes.io/projected/299b3c56-73aa-46e5-88af-7d5a07736c5e-kube-api-access-np57q\") pod \"openshift-state-metrics-b8f49f5c6-ht4qf\" (UID: \"299b3c56-73aa-46e5-88af-7d5a07736c5e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.204975 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.204956 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rvz\" (UniqueName: \"kubernetes.io/projected/700cd7ae-3574-4191-a379-72b399377322-kube-api-access-f4rvz\") pod \"node-exporter-sxq6d\" (UID: \"700cd7ae-3574-4191-a379-72b399377322\") " pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.205738 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.205714 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrk5n\" (UniqueName: \"kubernetes.io/projected/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-api-access-nrk5n\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.290955 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.290919 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" Jul 28 17:11:50.339075 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.338962 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sxq6d" Jul 28 17:11:50.350382 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:50.350350 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700cd7ae_3574_4191_a379_72b399377322.slice/crio-0ff4eb801089a6e4a071348cdd35557c70c592e62d17256c35bee30ac0124e7f WatchSource:0}: Error finding container 0ff4eb801089a6e4a071348cdd35557c70c592e62d17256c35bee30ac0124e7f: Status 404 returned error can't find the container with id 0ff4eb801089a6e4a071348cdd35557c70c592e62d17256c35bee30ac0124e7f Jul 28 17:11:50.416368 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.416344 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf"] Jul 28 17:11:50.418384 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:50.418363 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299b3c56_73aa_46e5_88af_7d5a07736c5e.slice/crio-807771fd29def61f524b79737a9499518714807d2ca66b2d5a44fc3a53d6a63a WatchSource:0}: Error finding container 807771fd29def61f524b79737a9499518714807d2ca66b2d5a44fc3a53d6a63a: Status 404 returned error can't find the container with id 807771fd29def61f524b79737a9499518714807d2ca66b2d5a44fc3a53d6a63a Jul 28 17:11:50.591947 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.591907 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mlskw" event={"ID":"2b9c67ba-8430-44b2-8779-aa136c0c6f17","Type":"ContainerStarted","Data":"f80be0f9f5d716e05b92d9bc098e405366d2c07ad6c409a4a0919e49c640d054"} Jul 28 17:11:50.592105 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.592010 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:11:50.593006 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.592983 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxq6d" event={"ID":"700cd7ae-3574-4191-a379-72b399377322","Type":"ContainerStarted","Data":"0ff4eb801089a6e4a071348cdd35557c70c592e62d17256c35bee30ac0124e7f"} Jul 28 17:11:50.594592 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.594570 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" event={"ID":"299b3c56-73aa-46e5-88af-7d5a07736c5e","Type":"ContainerStarted","Data":"f544cd9e35f90bd30be6f9ceef9e807c472f51a55049701453e614416a372f02"} Jul 28 17:11:50.594680 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.594620 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" event={"ID":"299b3c56-73aa-46e5-88af-7d5a07736c5e","Type":"ContainerStarted","Data":"afec26af17ea9d42adbc76b37b4244266168c27a2d48af4e2865b1cfd1277356"} Jul 28 17:11:50.594680 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.594640 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" event={"ID":"299b3c56-73aa-46e5-88af-7d5a07736c5e","Type":"ContainerStarted","Data":"807771fd29def61f524b79737a9499518714807d2ca66b2d5a44fc3a53d6a63a"} Jul 28 17:11:50.595905 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.595884 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-227qv" event={"ID":"58620e3a-8378-46e5-9d7a-aaf8e78edf6b","Type":"ContainerStarted","Data":"0c6ae90f2d733873fb201c54b0ebc43dd28b1542924f59d3d163cfeb0f9cf882"} Jul 28 17:11:50.614576 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.614481 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mlskw" podStartSLOduration=67.19022545 podStartE2EDuration="1m11.614464725s" totalImagesPullingTime="4.424239275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:50.613489604 +0000 UTC m=+71.961370537" watchObservedRunningTime="2026-07-28 17:11:50.614464725 +0000 UTC m=+71.962345658" Jul 28 17:11:50.638089 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.638040 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-227qv" podStartSLOduration=66.190573702 podStartE2EDuration="1m10.638021531s" totalImagesPullingTime="4.447447829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:50.637317135 +0000 UTC m=+71.985198067" watchObservedRunningTime="2026-07-28 17:11:50.638021531 +0000 UTC m=+71.985902463" Jul 28 17:11:50.699231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.699202 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.701537 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.701509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77210d4b-8a15-4440-8eb0-7e2f143dedd6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-89gv6\" (UID: \"77210d4b-8a15-4440-8eb0-7e2f143dedd6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:50.923245 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:50.923167 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" Jul 28 17:11:51.068648 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.068619 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6"] Jul 28 17:11:51.251314 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:51.251243 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77210d4b_8a15_4440_8eb0_7e2f143dedd6.slice/crio-50415f332c48f79f1af04b8628c1339cb6aa2679e187611a782da2538ed83f30 WatchSource:0}: Error finding container 50415f332c48f79f1af04b8628c1339cb6aa2679e187611a782da2538ed83f30: Status 404 returned error can't find the container with id 50415f332c48f79f1af04b8628c1339cb6aa2679e187611a782da2538ed83f30 Jul 28 17:11:51.601601 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.601567 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxq6d" event={"ID":"700cd7ae-3574-4191-a379-72b399377322","Type":"ContainerStarted","Data":"9143305446d26b65bd09f868d86efe96ca1f40b57707f8b936f51556dacd8040"} Jul 28 17:11:51.603915 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.603881 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" event={"ID":"299b3c56-73aa-46e5-88af-7d5a07736c5e","Type":"ContainerStarted","Data":"7be511a813b34c14ad8b5558cfc12da3a4a85fd289f5bfd0ca1c461cffa08976"} Jul 28 17:11:51.605455 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.605051 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" event={"ID":"77210d4b-8a15-4440-8eb0-7e2f143dedd6","Type":"ContainerStarted","Data":"50415f332c48f79f1af04b8628c1339cb6aa2679e187611a782da2538ed83f30"} Jul 28 17:11:51.645717 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.645661 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ht4qf" podStartSLOduration=1.665086354 podStartE2EDuration="2.64564215s" totalImagesPullingTime="980.555796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:51.645103911 +0000 UTC m=+72.992984843" watchObservedRunningTime="2026-07-28 17:11:51.64564215 +0000 UTC m=+72.993523081" Jul 28 17:11:51.964903 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.964865 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv"] Jul 28 17:11:51.968414 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.968388 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:51.971597 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.971577 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 17:11:51.971714 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.971639 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 17:11:51.971775 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.971577 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bsdgm\"" Jul 28 17:11:51.972181 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.972159 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 17:11:51.972288 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.972201 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 17:11:51.972288 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.972215 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bmdt34omkp384\"" Jul 28 17:11:51.972422 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.972337 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 17:11:51.983884 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:51.983856 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv"] Jul 28 17:11:52.112041 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.112012 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.112484 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.112054 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-tls\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.112484 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.112111 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5304b71-b487-4245-8bf1-aefc36b0ba9d-metrics-client-ca\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.112484 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.112157 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-grpc-tls\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.112484 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.112199 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.112484 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.112238 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.112484 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.112267 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.112484 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.112323 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985k8\" (UniqueName: \"kubernetes.io/projected/e5304b71-b487-4245-8bf1-aefc36b0ba9d-kube-api-access-985k8\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.213276 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.213239 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.213276 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.213282 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-tls\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.213520 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.213302 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5304b71-b487-4245-8bf1-aefc36b0ba9d-metrics-client-ca\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.213520 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.213340 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-grpc-tls\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.214062 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.213695 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.214062 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.213760 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.214062 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.213826 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.214062 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.213875 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-985k8\" (UniqueName: \"kubernetes.io/projected/e5304b71-b487-4245-8bf1-aefc36b0ba9d-kube-api-access-985k8\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.214339 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.214157 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5304b71-b487-4245-8bf1-aefc36b0ba9d-metrics-client-ca\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.216529 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.216506 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-tls\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.216643 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.216585 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.216643 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.216624 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-grpc-tls\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.216895 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.216876 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.216985 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.216954 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.217242 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.217213 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e5304b71-b487-4245-8bf1-aefc36b0ba9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.257709 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.257677 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-985k8\" (UniqueName: \"kubernetes.io/projected/e5304b71-b487-4245-8bf1-aefc36b0ba9d-kube-api-access-985k8\") pod \"thanos-querier-6b77c7dd89-rn8qv\" (UID: \"e5304b71-b487-4245-8bf1-aefc36b0ba9d\") " pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.279590 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.279555 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:52.460099 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.460073 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv"] Jul 28 17:11:52.461573 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:52.461550 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5304b71_b487_4245_8bf1_aefc36b0ba9d.slice/crio-ccea6f73c08197c22e17295786dbc8d1488a9389330883fb34cfea18bbff2499 WatchSource:0}: Error finding container ccea6f73c08197c22e17295786dbc8d1488a9389330883fb34cfea18bbff2499: Status 404 returned error can't find the container with id ccea6f73c08197c22e17295786dbc8d1488a9389330883fb34cfea18bbff2499 Jul 28 17:11:52.610525 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.610488 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" event={"ID":"77210d4b-8a15-4440-8eb0-7e2f143dedd6","Type":"ContainerStarted","Data":"356075f701ba202d8ada6e7eecb4d7107fe6090b7e012d8a50ca584795c566d0"} Jul 28 17:11:52.610695 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.610565 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" event={"ID":"77210d4b-8a15-4440-8eb0-7e2f143dedd6","Type":"ContainerStarted","Data":"ca0c97baa67f7d4bafa5b99ee708ea837f9bc81c51889df2a810d906ee41eef5"} Jul 28 17:11:52.610695 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.610599 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" event={"ID":"77210d4b-8a15-4440-8eb0-7e2f143dedd6","Type":"ContainerStarted","Data":"95c347135d5f22fb1c7744650c3e9ce42d83aa48a33c249df6e2a3b57c9f6dcc"} Jul 28 17:11:52.611748 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.611719 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" event={"ID":"e5304b71-b487-4245-8bf1-aefc36b0ba9d","Type":"ContainerStarted","Data":"ccea6f73c08197c22e17295786dbc8d1488a9389330883fb34cfea18bbff2499"} Jul 28 17:11:52.613604 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.613527 2570 generic.go:356] "Generic (PLEG): container finished" podID="700cd7ae-3574-4191-a379-72b399377322" containerID="9143305446d26b65bd09f868d86efe96ca1f40b57707f8b936f51556dacd8040" exitCode=0 Jul 28 17:11:52.614363 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.614332 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxq6d" event={"ID":"700cd7ae-3574-4191-a379-72b399377322","Type":"ContainerDied","Data":"9143305446d26b65bd09f868d86efe96ca1f40b57707f8b936f51556dacd8040"} Jul 28 17:11:52.638483 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:52.638433 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-89gv6" podStartSLOduration=2.529876722 podStartE2EDuration="3.638408397s" totalImagesPullingTime="1.108531675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:52.637477768 +0000 UTC m=+73.985358712" watchObservedRunningTime="2026-07-28 17:11:52.638408397 +0000 UTC m=+73.986289330" Jul 28 17:11:53.518441 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:53.518398 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dc7b9d64d-c24wq" Jul 28 17:11:53.621124 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:53.621075 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxq6d" event={"ID":"700cd7ae-3574-4191-a379-72b399377322","Type":"ContainerStarted","Data":"390c6680b94ec595190d6d9e6bf4ad68e6c58cc6c00b546697c55efc97d78a52"} Jul 28 17:11:53.621257 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:53.621155 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxq6d" event={"ID":"700cd7ae-3574-4191-a379-72b399377322","Type":"ContainerStarted","Data":"ce91380807a77db79ea6f3413d6166a3188a744fabb0761d441b78ee999e781f"} Jul 28 17:11:53.641935 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:53.641882 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sxq6d" podStartSLOduration=3.424964794 podStartE2EDuration="4.641867173s" totalImagesPullingTime="1.149433077s" totalInitContainerRuntime="67.469302ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:53.640674414 +0000 UTC m=+74.988555350" watchObservedRunningTime="2026-07-28 17:11:53.641867173 +0000 UTC m=+74.989748112" Jul 28 17:11:54.626453 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.626413 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" event={"ID":"e5304b71-b487-4245-8bf1-aefc36b0ba9d","Type":"ContainerStarted","Data":"f930f8ce055957fe5e3dfc19d7e4d40334aeaefd249a44930ad3336d5c0fcfab"} Jul 28 17:11:54.626850 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.626505 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" event={"ID":"e5304b71-b487-4245-8bf1-aefc36b0ba9d","Type":"ContainerStarted","Data":"8d9421a430363ab3e984fe6bf12ac790d85f876b64e847888f0bd71972368e23"} Jul 28 17:11:54.626850 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.626551 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" event={"ID":"e5304b71-b487-4245-8bf1-aefc36b0ba9d","Type":"ContainerStarted","Data":"57f2e0253cbfe07e10a0ebb78bfdae46894729f2d0f19d4ebf2e0cb10ae7df94"} Jul 28 17:11:54.780544 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.780465 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj"] Jul 28 17:11:54.783600 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.783571 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:54.787007 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.786975 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 17:11:54.787161 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.787143 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sk4xg\"" Jul 28 17:11:54.801508 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.801472 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj"] Jul 28 17:11:54.937931 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.937900 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmj8w\" (UniqueName: \"kubernetes.io/projected/a941163c-a5ee-4e18-b59d-d6436be35d81-kube-api-access-hmj8w\") pod \"monitoring-plugin-68b7fc9574-llkhj\" (UID: \"a941163c-a5ee-4e18-b59d-d6436be35d81\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:54.938096 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:54.937953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a941163c-a5ee-4e18-b59d-d6436be35d81-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llkhj\" (UID: \"a941163c-a5ee-4e18-b59d-d6436be35d81\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:55.039133 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.039047 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmj8w\" (UniqueName: \"kubernetes.io/projected/a941163c-a5ee-4e18-b59d-d6436be35d81-kube-api-access-hmj8w\") pod \"monitoring-plugin-68b7fc9574-llkhj\" (UID: \"a941163c-a5ee-4e18-b59d-d6436be35d81\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:55.039297 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.039135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a941163c-a5ee-4e18-b59d-d6436be35d81-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llkhj\" (UID: \"a941163c-a5ee-4e18-b59d-d6436be35d81\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:55.041909 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.041880 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a941163c-a5ee-4e18-b59d-d6436be35d81-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llkhj\" (UID: \"a941163c-a5ee-4e18-b59d-d6436be35d81\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:55.048040 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.048012 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmj8w\" (UniqueName: \"kubernetes.io/projected/a941163c-a5ee-4e18-b59d-d6436be35d81-kube-api-access-hmj8w\") pod \"monitoring-plugin-68b7fc9574-llkhj\" (UID: \"a941163c-a5ee-4e18-b59d-d6436be35d81\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:55.093716 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.093681 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:55.298473 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.298427 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj"] Jul 28 17:11:55.301071 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:11:55.301039 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda941163c_a5ee_4e18_b59d_d6436be35d81.slice/crio-e95acd6bfafac7a079227ceaa71853fb00277052e8b5ca771e65d0b2040c1f50 WatchSource:0}: Error finding container e95acd6bfafac7a079227ceaa71853fb00277052e8b5ca771e65d0b2040c1f50: Status 404 returned error can't find the container with id e95acd6bfafac7a079227ceaa71853fb00277052e8b5ca771e65d0b2040c1f50 Jul 28 17:11:55.631926 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.631891 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" event={"ID":"a941163c-a5ee-4e18-b59d-d6436be35d81","Type":"ContainerStarted","Data":"e95acd6bfafac7a079227ceaa71853fb00277052e8b5ca771e65d0b2040c1f50"} Jul 28 17:11:55.636128 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.636098 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" event={"ID":"e5304b71-b487-4245-8bf1-aefc36b0ba9d","Type":"ContainerStarted","Data":"d3b2119a92db1efd6ee69a489a9c325b4d7fda4b14ca7a6c42593b4a3af68238"} Jul 28 17:11:55.636268 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.636158 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" event={"ID":"e5304b71-b487-4245-8bf1-aefc36b0ba9d","Type":"ContainerStarted","Data":"5e5d157522e87b0e2832644e6aad70b5a397bd6d27d81b4ec7a99c2ddc9f22fe"} Jul 28 17:11:55.636268 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.636192 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" event={"ID":"e5304b71-b487-4245-8bf1-aefc36b0ba9d","Type":"ContainerStarted","Data":"933f575e016e4938aed8dae12981e032d0ad27f1f342dd5dcd6bdd37db6bc23c"} Jul 28 17:11:55.636268 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.636226 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:11:55.662642 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:55.662585 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" podStartSLOduration=2.119783287 podStartE2EDuration="4.66256783s" totalImagesPullingTime="2.542784543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:11:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:55.66163402 +0000 UTC m=+77.009514951" watchObservedRunningTime="2026-07-28 17:11:55.66256783 +0000 UTC m=+77.010448762" Jul 28 17:11:57.646937 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:57.646901 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" event={"ID":"a941163c-a5ee-4e18-b59d-d6436be35d81","Type":"ContainerStarted","Data":"b7bff97afe6bdaa76a688e545c865dd720099c3423e19364ae59e92df99cdc6a"} Jul 28 17:11:57.647325 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:57.647090 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:57.651761 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:57.651736 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" Jul 28 17:11:57.666618 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:11:57.666573 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llkhj" podStartSLOduration=2.306399706 podStartE2EDuration="3.66655949s" totalImagesPullingTime="1.360159784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:57.666433609 +0000 UTC m=+79.014314540" watchObservedRunningTime="2026-07-28 17:11:57.66655949 +0000 UTC m=+79.014440421" Jul 28 17:12:01.646946 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:12:01.646843 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b77c7dd89-rn8qv" Jul 28 17:12:07.063055 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:12:07.063022 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2shdc_5acd1fa5-910f-4598-8344-5808f48f1cca/serve-healthcheck-canary/0.log" Jul 28 17:12:21.608476 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:12:21.608444 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mlskw" Jul 28 17:13:14.332321 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.332283 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65d4857c-vh4zs"] Jul 28 17:13:14.334770 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.334751 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.337761 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.337735 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 17:13:14.337761 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.337758 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 17:13:14.338016 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.337773 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l59lj\"" Jul 28 17:13:14.338016 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.337759 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 17:13:14.338016 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.337854 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 17:13:14.338016 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.337736 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 17:13:14.343412 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.343386 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 17:13:14.349963 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.349929 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65d4857c-vh4zs"] Jul 28 17:13:14.416132 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.416097 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-secret-telemeter-client\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.416132 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.416136 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-serving-certs-ca-bundle\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.416363 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.416160 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-metrics-client-ca\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.416363 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.416247 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-telemeter-client-tls\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.416363 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.416276 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkcsq\" (UniqueName: \"kubernetes.io/projected/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-kube-api-access-tkcsq\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.416363 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.416296 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.416363 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.416358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.416536 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.416381 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-federate-client-tls\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.517338 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.517288 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-telemeter-client-tls\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.517338 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.517339 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkcsq\" (UniqueName: \"kubernetes.io/projected/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-kube-api-access-tkcsq\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.517589 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.517362 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.517589 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.517402 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.517589 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.517426 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-federate-client-tls\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.517589 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.517454 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-secret-telemeter-client\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.517780 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.517603 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-serving-certs-ca-bundle\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.517780 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.517651 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-metrics-client-ca\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.518433 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.518399 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-serving-certs-ca-bundle\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.518562 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.518428 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.518562 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.518437 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-metrics-client-ca\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.520089 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.520062 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.520089 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.520081 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-federate-client-tls\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.520215 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.520127 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-secret-telemeter-client\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.520256 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.520217 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-telemeter-client-tls\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.526440 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.526412 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkcsq\" (UniqueName: \"kubernetes.io/projected/aba2ef3b-e172-45b9-9217-8115c1bc9ffb-kube-api-access-tkcsq\") pod \"telemeter-client-65d4857c-vh4zs\" (UID: \"aba2ef3b-e172-45b9-9217-8115c1bc9ffb\") " pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.645366 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.645329 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" Jul 28 17:13:14.781625 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.781591 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65d4857c-vh4zs"] Jul 28 17:13:14.784780 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:13:14.784750 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba2ef3b_e172_45b9_9217_8115c1bc9ffb.slice/crio-03f6503c72fb1cfec89eaa4fa4594b347ea682bc29ca259a23b9787847ab3c3b WatchSource:0}: Error finding container 03f6503c72fb1cfec89eaa4fa4594b347ea682bc29ca259a23b9787847ab3c3b: Status 404 returned error can't find the container with id 03f6503c72fb1cfec89eaa4fa4594b347ea682bc29ca259a23b9787847ab3c3b Jul 28 17:13:14.909778 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:14.909678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" event={"ID":"aba2ef3b-e172-45b9-9217-8115c1bc9ffb","Type":"ContainerStarted","Data":"03f6503c72fb1cfec89eaa4fa4594b347ea682bc29ca259a23b9787847ab3c3b"} Jul 28 17:13:16.919431 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:16.919394 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" event={"ID":"aba2ef3b-e172-45b9-9217-8115c1bc9ffb","Type":"ContainerStarted","Data":"941217dc7786412f8dc6850001bba0a24783487c894f288fbc30ffc971e90738"} Jul 28 17:13:17.924994 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:17.924895 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" event={"ID":"aba2ef3b-e172-45b9-9217-8115c1bc9ffb","Type":"ContainerStarted","Data":"f77405d53fb04693c4b3e65cfe8afd55110f657aff009e0ddc053727d696cbf0"} Jul 28 17:13:17.924994 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:17.924962 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" event={"ID":"aba2ef3b-e172-45b9-9217-8115c1bc9ffb","Type":"ContainerStarted","Data":"7ac71d7f99cbdfe860500bf4602b03d849bdf03c625f65f47741bda7710242c8"} Jul 28 17:13:17.950026 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:13:17.949967 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65d4857c-vh4zs" podStartSLOduration=1.22265008 podStartE2EDuration="3.949947894s" totalImagesPullingTime="2.727297814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:17.948155327 +0000 UTC m=+159.296036259" watchObservedRunningTime="2026-07-28 17:13:17.949947894 +0000 UTC m=+159.297828825" Jul 28 17:15:39.044024 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:15:39.043995 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 17:16:51.420630 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.420597 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7"] Jul 28 17:16:51.422931 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.422914 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.425556 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.425525 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 17:16:51.425556 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.425574 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rk85m\"" Jul 28 17:16:51.426707 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.426689 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 17:16:51.442108 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.442063 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7"] Jul 28 17:16:51.451008 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.450977 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql9xs\" (UniqueName: \"kubernetes.io/projected/e825f354-3061-496a-af26-a95a32b9ed3e-kube-api-access-ql9xs\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.451155 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.451016 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.451155 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.451091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.552289 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.552258 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql9xs\" (UniqueName: \"kubernetes.io/projected/e825f354-3061-496a-af26-a95a32b9ed3e-kube-api-access-ql9xs\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.552289 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.552295 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.552554 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.552365 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.552699 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.552681 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.552745 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.552718 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.561958 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.561929 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql9xs\" (UniqueName: \"kubernetes.io/projected/e825f354-3061-496a-af26-a95a32b9ed3e-kube-api-access-ql9xs\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.731665 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.731573 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:16:51.865224 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.865193 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7"] Jul 28 17:16:51.868193 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:16:51.868166 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode825f354_3061_496a_af26_a95a32b9ed3e.slice/crio-09b1868289d44f6653884a43566d425142cf25cbb2955833319809f6ba7c4e97 WatchSource:0}: Error finding container 09b1868289d44f6653884a43566d425142cf25cbb2955833319809f6ba7c4e97: Status 404 returned error can't find the container with id 09b1868289d44f6653884a43566d425142cf25cbb2955833319809f6ba7c4e97 Jul 28 17:16:51.870118 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:51.870103 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:16:52.665065 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:16:52.665026 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" event={"ID":"e825f354-3061-496a-af26-a95a32b9ed3e","Type":"ContainerStarted","Data":"09b1868289d44f6653884a43566d425142cf25cbb2955833319809f6ba7c4e97"} Jul 28 17:17:01.703508 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:01.703471 2570 generic.go:356] "Generic (PLEG): container finished" podID="e825f354-3061-496a-af26-a95a32b9ed3e" containerID="69e0854a09142c16369bdc658ebfc7cf2ab835bd0e5f9203fd880b7f97f605e0" exitCode=0 Jul 28 17:17:01.703923 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:01.703561 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" event={"ID":"e825f354-3061-496a-af26-a95a32b9ed3e","Type":"ContainerDied","Data":"69e0854a09142c16369bdc658ebfc7cf2ab835bd0e5f9203fd880b7f97f605e0"} Jul 28 17:17:04.715459 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:04.715428 2570 generic.go:356] "Generic (PLEG): container finished" podID="e825f354-3061-496a-af26-a95a32b9ed3e" containerID="36db1cee2e52198b5309941f3a1afba662a7447dcadfdcc1e8e6ffb3ee38a8da" exitCode=0 Jul 28 17:17:04.715874 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:04.715507 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" event={"ID":"e825f354-3061-496a-af26-a95a32b9ed3e","Type":"ContainerDied","Data":"36db1cee2e52198b5309941f3a1afba662a7447dcadfdcc1e8e6ffb3ee38a8da"} Jul 28 17:17:11.746763 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:11.746727 2570 generic.go:356] "Generic (PLEG): container finished" podID="e825f354-3061-496a-af26-a95a32b9ed3e" containerID="9bc38d79441639984fe1aafc87f1a4e6f0b196f9ab03ac88f6d0a0d44aba4c87" exitCode=0 Jul 28 17:17:11.747180 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:11.746829 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" event={"ID":"e825f354-3061-496a-af26-a95a32b9ed3e","Type":"ContainerDied","Data":"9bc38d79441639984fe1aafc87f1a4e6f0b196f9ab03ac88f6d0a0d44aba4c87"} Jul 28 17:17:12.873475 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:12.873449 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:17:12.939309 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:12.939271 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql9xs\" (UniqueName: \"kubernetes.io/projected/e825f354-3061-496a-af26-a95a32b9ed3e-kube-api-access-ql9xs\") pod \"e825f354-3061-496a-af26-a95a32b9ed3e\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " Jul 28 17:17:12.939482 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:12.939320 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-util\") pod \"e825f354-3061-496a-af26-a95a32b9ed3e\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " Jul 28 17:17:12.939482 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:12.939354 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-bundle\") pod \"e825f354-3061-496a-af26-a95a32b9ed3e\" (UID: \"e825f354-3061-496a-af26-a95a32b9ed3e\") " Jul 28 17:17:12.940007 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:12.939979 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-bundle" (OuterVolumeSpecName: "bundle") pod "e825f354-3061-496a-af26-a95a32b9ed3e" (UID: "e825f354-3061-496a-af26-a95a32b9ed3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:17:12.941502 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:12.941478 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e825f354-3061-496a-af26-a95a32b9ed3e-kube-api-access-ql9xs" (OuterVolumeSpecName: "kube-api-access-ql9xs") pod "e825f354-3061-496a-af26-a95a32b9ed3e" (UID: "e825f354-3061-496a-af26-a95a32b9ed3e"). InnerVolumeSpecName "kube-api-access-ql9xs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:17:12.946544 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:12.946492 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-util" (OuterVolumeSpecName: "util") pod "e825f354-3061-496a-af26-a95a32b9ed3e" (UID: "e825f354-3061-496a-af26-a95a32b9ed3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:17:13.039963 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:13.039871 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql9xs\" (UniqueName: \"kubernetes.io/projected/e825f354-3061-496a-af26-a95a32b9ed3e-kube-api-access-ql9xs\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:17:13.039963 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:13.039906 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-util\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:17:13.039963 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:13.039916 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e825f354-3061-496a-af26-a95a32b9ed3e-bundle\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:17:13.755520 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:13.755488 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" event={"ID":"e825f354-3061-496a-af26-a95a32b9ed3e","Type":"ContainerDied","Data":"09b1868289d44f6653884a43566d425142cf25cbb2955833319809f6ba7c4e97"} Jul 28 17:17:13.755520 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:13.755510 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rdzm7" Jul 28 17:17:13.755721 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:13.755532 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09b1868289d44f6653884a43566d425142cf25cbb2955833319809f6ba7c4e97" Jul 28 17:17:19.791421 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.791384 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4"] Jul 28 17:17:19.791830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.791673 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e825f354-3061-496a-af26-a95a32b9ed3e" containerName="util" Jul 28 17:17:19.791830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.791686 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e825f354-3061-496a-af26-a95a32b9ed3e" containerName="util" Jul 28 17:17:19.791830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.791706 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e825f354-3061-496a-af26-a95a32b9ed3e" containerName="extract" Jul 28 17:17:19.791830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.791712 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e825f354-3061-496a-af26-a95a32b9ed3e" containerName="extract" Jul 28 17:17:19.791830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.791719 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e825f354-3061-496a-af26-a95a32b9ed3e" containerName="pull" Jul 28 17:17:19.791830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.791724 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e825f354-3061-496a-af26-a95a32b9ed3e" containerName="pull" Jul 28 17:17:19.791830 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.791766 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e825f354-3061-496a-af26-a95a32b9ed3e" containerName="extract" Jul 28 17:17:19.795285 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.795267 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:19.798194 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.798176 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 28 17:17:19.798298 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.798231 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 28 17:17:19.798298 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.798248 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-j9x84\"" Jul 28 17:17:19.798430 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.798320 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 28 17:17:19.808866 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.808843 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4"] Jul 28 17:17:19.897552 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.897523 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9c658a32-242b-4684-b88b-d45adfcf24d2-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4\" (UID: \"9c658a32-242b-4684-b88b-d45adfcf24d2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:19.897735 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.897559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpcf4\" (UniqueName: \"kubernetes.io/projected/9c658a32-242b-4684-b88b-d45adfcf24d2-kube-api-access-rpcf4\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4\" (UID: \"9c658a32-242b-4684-b88b-d45adfcf24d2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:19.997868 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.997842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9c658a32-242b-4684-b88b-d45adfcf24d2-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4\" (UID: \"9c658a32-242b-4684-b88b-d45adfcf24d2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:19.998037 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:19.997875 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpcf4\" (UniqueName: \"kubernetes.io/projected/9c658a32-242b-4684-b88b-d45adfcf24d2-kube-api-access-rpcf4\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4\" (UID: \"9c658a32-242b-4684-b88b-d45adfcf24d2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:20.000225 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:20.000202 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9c658a32-242b-4684-b88b-d45adfcf24d2-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4\" (UID: \"9c658a32-242b-4684-b88b-d45adfcf24d2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:20.013243 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:20.013208 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpcf4\" (UniqueName: \"kubernetes.io/projected/9c658a32-242b-4684-b88b-d45adfcf24d2-kube-api-access-rpcf4\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4\" (UID: \"9c658a32-242b-4684-b88b-d45adfcf24d2\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:20.105564 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:20.105527 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:20.235069 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:17:20.235037 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c658a32_242b_4684_b88b_d45adfcf24d2.slice/crio-da687fd7e8c606f42e2798a823b9e1b8088e6e3493818e9409655d63a3f6e72d WatchSource:0}: Error finding container da687fd7e8c606f42e2798a823b9e1b8088e6e3493818e9409655d63a3f6e72d: Status 404 returned error can't find the container with id da687fd7e8c606f42e2798a823b9e1b8088e6e3493818e9409655d63a3f6e72d Jul 28 17:17:20.242399 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:20.242375 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4"] Jul 28 17:17:20.781676 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:20.781642 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" event={"ID":"9c658a32-242b-4684-b88b-d45adfcf24d2","Type":"ContainerStarted","Data":"da687fd7e8c606f42e2798a823b9e1b8088e6e3493818e9409655d63a3f6e72d"} Jul 28 17:17:23.795623 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:23.795584 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" event={"ID":"9c658a32-242b-4684-b88b-d45adfcf24d2","Type":"ContainerStarted","Data":"df23c2e9a376f2e786a872f89c29a667cab21a9d463d1691e9f63d3654c8b73f"} Jul 28 17:17:23.796104 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:23.795657 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:23.830733 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:23.830681 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" podStartSLOduration=1.725283722 podStartE2EDuration="4.830664611s" totalImagesPullingTime="3.105380889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:23.828925064 +0000 UTC m=+405.176805996" watchObservedRunningTime="2026-07-28 17:17:23.830664611 +0000 UTC m=+405.178545544" Jul 28 17:17:24.148587 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.148552 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-qw5m4"] Jul 28 17:17:24.150768 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.150748 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.154155 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.154128 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 28 17:17:24.154976 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.154958 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 28 17:17:24.155231 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.155217 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8jgdj\"" Jul 28 17:17:24.165194 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.165165 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-qw5m4"] Jul 28 17:17:24.235165 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.235120 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-certificates\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.235358 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.235211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c40d325a-4d1f-49ac-bccb-bebf882801a8-cabundle0\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.235358 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.235242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45qhw\" (UniqueName: \"kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-kube-api-access-45qhw\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.335942 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.335909 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-certificates\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.335942 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.335954 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c40d325a-4d1f-49ac-bccb-bebf882801a8-cabundle0\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.336201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.335976 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45qhw\" (UniqueName: \"kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-kube-api-access-45qhw\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.336201 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:17:24.336057 2570 secret.go:281] references non-existent secret key: ca.crt Jul 28 17:17:24.336201 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:17:24.336077 2570 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 28 17:17:24.336201 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:17:24.336086 2570 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-qw5m4: references non-existent secret key: ca.crt Jul 28 17:17:24.336201 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:17:24.336139 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-certificates podName:c40d325a-4d1f-49ac-bccb-bebf882801a8 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:24.836123504 +0000 UTC m=+406.184004413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-certificates") pod "keda-operator-77f648d694-qw5m4" (UID: "c40d325a-4d1f-49ac-bccb-bebf882801a8") : references non-existent secret key: ca.crt Jul 28 17:17:24.336664 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.336641 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c40d325a-4d1f-49ac-bccb-bebf882801a8-cabundle0\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.344916 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.344891 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45qhw\" (UniqueName: \"kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-kube-api-access-45qhw\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.396360 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.396326 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-v95ft"] Jul 28 17:17:24.398510 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.398493 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.401244 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.401185 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 28 17:17:24.413728 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.413689 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-v95ft"] Jul 28 17:17:24.538070 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.538033 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjxb\" (UniqueName: \"kubernetes.io/projected/e1ba87f6-3180-41e8-b263-de04134f88cf-kube-api-access-qwjxb\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.538245 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.538116 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e1ba87f6-3180-41e8-b263-de04134f88cf-certificates\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.538245 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.538141 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e1ba87f6-3180-41e8-b263-de04134f88cf-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.639438 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.639402 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e1ba87f6-3180-41e8-b263-de04134f88cf-certificates\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.639438 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.639442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e1ba87f6-3180-41e8-b263-de04134f88cf-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.639656 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.639483 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjxb\" (UniqueName: \"kubernetes.io/projected/e1ba87f6-3180-41e8-b263-de04134f88cf-kube-api-access-qwjxb\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.639969 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.639952 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e1ba87f6-3180-41e8-b263-de04134f88cf-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.641987 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.641967 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e1ba87f6-3180-41e8-b263-de04134f88cf-certificates\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.648964 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.648940 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjxb\" (UniqueName: \"kubernetes.io/projected/e1ba87f6-3180-41e8-b263-de04134f88cf-kube-api-access-qwjxb\") pod \"keda-metrics-apiserver-55557df8c-v95ft\" (UID: \"e1ba87f6-3180-41e8-b263-de04134f88cf\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.709009 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.708922 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:24.829505 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.829474 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-68rqv"] Jul 28 17:17:24.832348 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.832325 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:24.841396 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.841364 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-certificates\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.842257 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.842234 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 28 17:17:24.844021 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.843997 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c40d325a-4d1f-49ac-bccb-bebf882801a8-certificates\") pod \"keda-operator-77f648d694-qw5m4\" (UID: \"c40d325a-4d1f-49ac-bccb-bebf882801a8\") " pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:24.854258 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.854215 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-68rqv"] Jul 28 17:17:24.858737 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.858511 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-v95ft"] Jul 28 17:17:24.861280 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:17:24.861253 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ba87f6_3180_41e8_b263_de04134f88cf.slice/crio-2acb5429a9a47ec0039c8ee053ec4c3410853c48f1de589ae23d41bafa6c0ea5 WatchSource:0}: Error finding container 2acb5429a9a47ec0039c8ee053ec4c3410853c48f1de589ae23d41bafa6c0ea5: Status 404 returned error can't find the container with id 2acb5429a9a47ec0039c8ee053ec4c3410853c48f1de589ae23d41bafa6c0ea5 Jul 28 17:17:24.942396 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.942358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/88eabc3a-d794-487a-99d0-407272882fa7-certificates\") pod \"keda-admission-56f9798bb4-68rqv\" (UID: \"88eabc3a-d794-487a-99d0-407272882fa7\") " pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:24.942606 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:24.942432 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z6kc\" (UniqueName: \"kubernetes.io/projected/88eabc3a-d794-487a-99d0-407272882fa7-kube-api-access-6z6kc\") pod \"keda-admission-56f9798bb4-68rqv\" (UID: \"88eabc3a-d794-487a-99d0-407272882fa7\") " pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:25.043733 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.043634 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/88eabc3a-d794-487a-99d0-407272882fa7-certificates\") pod \"keda-admission-56f9798bb4-68rqv\" (UID: \"88eabc3a-d794-487a-99d0-407272882fa7\") " pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:25.043733 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.043677 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z6kc\" (UniqueName: \"kubernetes.io/projected/88eabc3a-d794-487a-99d0-407272882fa7-kube-api-access-6z6kc\") pod \"keda-admission-56f9798bb4-68rqv\" (UID: \"88eabc3a-d794-487a-99d0-407272882fa7\") " pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:25.046158 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.046136 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/88eabc3a-d794-487a-99d0-407272882fa7-certificates\") pod \"keda-admission-56f9798bb4-68rqv\" (UID: \"88eabc3a-d794-487a-99d0-407272882fa7\") " pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:25.055058 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.055035 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z6kc\" (UniqueName: \"kubernetes.io/projected/88eabc3a-d794-487a-99d0-407272882fa7-kube-api-access-6z6kc\") pod \"keda-admission-56f9798bb4-68rqv\" (UID: \"88eabc3a-d794-487a-99d0-407272882fa7\") " pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:25.060902 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.060873 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:25.143212 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.143182 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:25.198675 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.198646 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-qw5m4"] Jul 28 17:17:25.201638 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:17:25.201603 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40d325a_4d1f_49ac_bccb_bebf882801a8.slice/crio-ab77dee37d20aee8e49f66726af6de2b4ef174f3b7c39f8b4ae6d9684c3f1346 WatchSource:0}: Error finding container ab77dee37d20aee8e49f66726af6de2b4ef174f3b7c39f8b4ae6d9684c3f1346: Status 404 returned error can't find the container with id ab77dee37d20aee8e49f66726af6de2b4ef174f3b7c39f8b4ae6d9684c3f1346 Jul 28 17:17:25.286592 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.286560 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-68rqv"] Jul 28 17:17:25.288653 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:17:25.288630 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88eabc3a_d794_487a_99d0_407272882fa7.slice/crio-faa2aca78ef27af833d8a5a7950d1b22a6a8448efb40ef4ecedfc059df1059f4 WatchSource:0}: Error finding container faa2aca78ef27af833d8a5a7950d1b22a6a8448efb40ef4ecedfc059df1059f4: Status 404 returned error can't find the container with id faa2aca78ef27af833d8a5a7950d1b22a6a8448efb40ef4ecedfc059df1059f4 Jul 28 17:17:25.806573 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.806535 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" event={"ID":"e1ba87f6-3180-41e8-b263-de04134f88cf","Type":"ContainerStarted","Data":"2acb5429a9a47ec0039c8ee053ec4c3410853c48f1de589ae23d41bafa6c0ea5"} Jul 28 17:17:25.807850 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.807821 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-68rqv" event={"ID":"88eabc3a-d794-487a-99d0-407272882fa7","Type":"ContainerStarted","Data":"faa2aca78ef27af833d8a5a7950d1b22a6a8448efb40ef4ecedfc059df1059f4"} Jul 28 17:17:25.809078 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:25.809038 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-qw5m4" event={"ID":"c40d325a-4d1f-49ac-bccb-bebf882801a8","Type":"ContainerStarted","Data":"ab77dee37d20aee8e49f66726af6de2b4ef174f3b7c39f8b4ae6d9684c3f1346"} Jul 28 17:17:28.834502 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:28.834453 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-68rqv" event={"ID":"88eabc3a-d794-487a-99d0-407272882fa7","Type":"ContainerStarted","Data":"fcbd980635cd76522c89e399a3439c2e247377cc13683ff23a62ed20c60f850d"} Jul 28 17:17:28.835014 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:28.834567 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:28.836415 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:28.836384 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" event={"ID":"e1ba87f6-3180-41e8-b263-de04134f88cf","Type":"ContainerStarted","Data":"a172ffd725fdc867b247406d7081a0dac651236ad57ecce636c35a6c8709c22c"} Jul 28 17:17:28.836555 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:28.836537 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:28.859111 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:28.859049 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-68rqv" podStartSLOduration=2.161904039 podStartE2EDuration="4.859032434s" totalImagesPullingTime="2.697128395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:28.857356407 +0000 UTC m=+410.205237340" watchObservedRunningTime="2026-07-28 17:17:28.859032434 +0000 UTC m=+410.206913366" Jul 28 17:17:28.877491 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:28.877444 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" podStartSLOduration=1.751005534 podStartE2EDuration="4.877428902s" totalImagesPullingTime="3.126423368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:28.876632775 +0000 UTC m=+410.224513708" watchObservedRunningTime="2026-07-28 17:17:28.877428902 +0000 UTC m=+410.225309836" Jul 28 17:17:29.841963 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:29.841922 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-qw5m4" event={"ID":"c40d325a-4d1f-49ac-bccb-bebf882801a8","Type":"ContainerStarted","Data":"7d342fec209b103d3a5140117d138ce1653a0754a37c9563d2e7156723a59d87"} Jul 28 17:17:29.842417 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:29.842096 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:17:29.862817 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:29.862752 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-qw5m4" podStartSLOduration=1.8346391020000001 podStartE2EDuration="5.86273362s" totalImagesPullingTime="4.028094518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:29.861029129 +0000 UTC m=+411.208910061" watchObservedRunningTime="2026-07-28 17:17:29.86273362 +0000 UTC m=+411.210614552" Jul 28 17:17:39.846147 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:39.846118 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-v95ft" Jul 28 17:17:44.803694 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:44.803666 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll5l4" Jul 28 17:17:49.844208 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:49.844163 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-68rqv" Jul 28 17:17:50.849300 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:17:50.849268 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-qw5m4" Jul 28 17:18:43.619357 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.619320 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-vgttx"] Jul 28 17:18:43.621594 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.621575 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:43.624443 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.624420 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 17:18:43.625325 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.625297 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 17:18:43.625325 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.625310 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 28 17:18:43.625515 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.625335 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-9x777\"" Jul 28 17:18:43.630997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.630976 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-r5wvs"] Jul 28 17:18:43.633495 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.633476 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:43.635283 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.635263 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-vgttx"] Jul 28 17:18:43.636349 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.636331 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 28 17:18:43.636437 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.636426 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-t6wll\"" Jul 28 17:18:43.648372 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.648345 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-r5wvs"] Jul 28 17:18:43.663958 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.663932 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-2bwrc"] Jul 28 17:18:43.666350 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.666324 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:43.668587 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.668563 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92lwv\" (UniqueName: \"kubernetes.io/projected/aa9fef6c-9c3f-4587-9cf7-70010af70f49-kube-api-access-92lwv\") pod \"llmisvc-controller-manager-654c557856-r5wvs\" (UID: \"aa9fef6c-9c3f-4587-9cf7-70010af70f49\") " pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:43.668726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.668626 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert\") pod \"kserve-controller-manager-cd4d44c67-vgttx\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:43.668726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.668653 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk4fn\" (UniqueName: \"kubernetes.io/projected/3cc5b5e9-166e-42b0-872f-670a18cee469-kube-api-access-kk4fn\") pod \"kserve-controller-manager-cd4d44c67-vgttx\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:43.668726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.668723 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa9fef6c-9c3f-4587-9cf7-70010af70f49-cert\") pod \"llmisvc-controller-manager-654c557856-r5wvs\" (UID: \"aa9fef6c-9c3f-4587-9cf7-70010af70f49\") " pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:43.669046 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.669026 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-9w9f9\"" Jul 28 17:18:43.669507 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.669489 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 28 17:18:43.677855 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.677833 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-2bwrc"] Jul 28 17:18:43.769914 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.769867 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92lwv\" (UniqueName: \"kubernetes.io/projected/aa9fef6c-9c3f-4587-9cf7-70010af70f49-kube-api-access-92lwv\") pod \"llmisvc-controller-manager-654c557856-r5wvs\" (UID: \"aa9fef6c-9c3f-4587-9cf7-70010af70f49\") " pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:43.769914 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.769932 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xts2f\" (UniqueName: \"kubernetes.io/projected/ff2c4a24-c817-4f0c-af19-31354f31095e-kube-api-access-xts2f\") pod \"seaweedfs-64568bcd49-2bwrc\" (UID: \"ff2c4a24-c817-4f0c-af19-31354f31095e\") " pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:43.770149 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.769958 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert\") pod \"kserve-controller-manager-cd4d44c67-vgttx\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:43.770149 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.769980 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk4fn\" (UniqueName: \"kubernetes.io/projected/3cc5b5e9-166e-42b0-872f-670a18cee469-kube-api-access-kk4fn\") pod \"kserve-controller-manager-cd4d44c67-vgttx\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:43.770149 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.770001 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa9fef6c-9c3f-4587-9cf7-70010af70f49-cert\") pod \"llmisvc-controller-manager-654c557856-r5wvs\" (UID: \"aa9fef6c-9c3f-4587-9cf7-70010af70f49\") " pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:43.770149 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.770027 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ff2c4a24-c817-4f0c-af19-31354f31095e-data\") pod \"seaweedfs-64568bcd49-2bwrc\" (UID: \"ff2c4a24-c817-4f0c-af19-31354f31095e\") " pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:43.770149 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:18:43.770043 2570 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 28 17:18:43.770149 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:18:43.770117 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert podName:3cc5b5e9-166e-42b0-872f-670a18cee469 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:44.270098184 +0000 UTC m=+485.617979102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert") pod "kserve-controller-manager-cd4d44c67-vgttx" (UID: "3cc5b5e9-166e-42b0-872f-670a18cee469") : secret "kserve-webhook-server-cert" not found Jul 28 17:18:43.772479 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.772450 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa9fef6c-9c3f-4587-9cf7-70010af70f49-cert\") pod \"llmisvc-controller-manager-654c557856-r5wvs\" (UID: \"aa9fef6c-9c3f-4587-9cf7-70010af70f49\") " pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:43.780059 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.780031 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk4fn\" (UniqueName: \"kubernetes.io/projected/3cc5b5e9-166e-42b0-872f-670a18cee469-kube-api-access-kk4fn\") pod \"kserve-controller-manager-cd4d44c67-vgttx\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:43.780177 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.780063 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92lwv\" (UniqueName: \"kubernetes.io/projected/aa9fef6c-9c3f-4587-9cf7-70010af70f49-kube-api-access-92lwv\") pod \"llmisvc-controller-manager-654c557856-r5wvs\" (UID: \"aa9fef6c-9c3f-4587-9cf7-70010af70f49\") " pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:43.871436 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.871329 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ff2c4a24-c817-4f0c-af19-31354f31095e-data\") pod \"seaweedfs-64568bcd49-2bwrc\" (UID: \"ff2c4a24-c817-4f0c-af19-31354f31095e\") " pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:43.871619 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.871444 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xts2f\" (UniqueName: \"kubernetes.io/projected/ff2c4a24-c817-4f0c-af19-31354f31095e-kube-api-access-xts2f\") pod \"seaweedfs-64568bcd49-2bwrc\" (UID: \"ff2c4a24-c817-4f0c-af19-31354f31095e\") " pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:43.871731 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.871708 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ff2c4a24-c817-4f0c-af19-31354f31095e-data\") pod \"seaweedfs-64568bcd49-2bwrc\" (UID: \"ff2c4a24-c817-4f0c-af19-31354f31095e\") " pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:43.885098 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.885073 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xts2f\" (UniqueName: \"kubernetes.io/projected/ff2c4a24-c817-4f0c-af19-31354f31095e-kube-api-access-xts2f\") pod \"seaweedfs-64568bcd49-2bwrc\" (UID: \"ff2c4a24-c817-4f0c-af19-31354f31095e\") " pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:43.944105 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.944064 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:43.975876 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:43.975828 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:44.079383 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:44.079349 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-r5wvs"] Jul 28 17:18:44.083521 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:18:44.083494 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa9fef6c_9c3f_4587_9cf7_70010af70f49.slice/crio-91cda671c841f0effe93436876853cb9c99d3872404ff97125f5bda1ec1b8ef1 WatchSource:0}: Error finding container 91cda671c841f0effe93436876853cb9c99d3872404ff97125f5bda1ec1b8ef1: Status 404 returned error can't find the container with id 91cda671c841f0effe93436876853cb9c99d3872404ff97125f5bda1ec1b8ef1 Jul 28 17:18:44.119669 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:44.119647 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-2bwrc"] Jul 28 17:18:44.121877 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:18:44.121820 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2c4a24_c817_4f0c_af19_31354f31095e.slice/crio-5f9e70def4214f02328083dd14ad94aec5d00573f28426e82d66f72e3d1d01b6 WatchSource:0}: Error finding container 5f9e70def4214f02328083dd14ad94aec5d00573f28426e82d66f72e3d1d01b6: Status 404 returned error can't find the container with id 5f9e70def4214f02328083dd14ad94aec5d00573f28426e82d66f72e3d1d01b6 Jul 28 17:18:44.145689 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:44.145657 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-2bwrc" event={"ID":"ff2c4a24-c817-4f0c-af19-31354f31095e","Type":"ContainerStarted","Data":"5f9e70def4214f02328083dd14ad94aec5d00573f28426e82d66f72e3d1d01b6"} Jul 28 17:18:44.146699 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:44.146678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" event={"ID":"aa9fef6c-9c3f-4587-9cf7-70010af70f49","Type":"ContainerStarted","Data":"91cda671c841f0effe93436876853cb9c99d3872404ff97125f5bda1ec1b8ef1"} Jul 28 17:18:44.274057 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:44.274019 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert\") pod \"kserve-controller-manager-cd4d44c67-vgttx\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:44.276417 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:44.276397 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert\") pod \"kserve-controller-manager-cd4d44c67-vgttx\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:44.531867 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:44.531772 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:44.698925 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:44.698867 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-vgttx"] Jul 28 17:18:44.752173 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:18:44.752135 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc5b5e9_166e_42b0_872f_670a18cee469.slice/crio-fda7cb6bd248158611d83daa2d6801caeb8d6959940a55e37e217f395f4f9a22 WatchSource:0}: Error finding container fda7cb6bd248158611d83daa2d6801caeb8d6959940a55e37e217f395f4f9a22: Status 404 returned error can't find the container with id fda7cb6bd248158611d83daa2d6801caeb8d6959940a55e37e217f395f4f9a22 Jul 28 17:18:45.153021 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:45.152985 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" event={"ID":"3cc5b5e9-166e-42b0-872f-670a18cee469","Type":"ContainerStarted","Data":"fda7cb6bd248158611d83daa2d6801caeb8d6959940a55e37e217f395f4f9a22"} Jul 28 17:18:49.175832 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.175719 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" event={"ID":"3cc5b5e9-166e-42b0-872f-670a18cee469","Type":"ContainerStarted","Data":"55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c"} Jul 28 17:18:49.175832 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.175782 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:18:49.177148 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.177118 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-2bwrc" event={"ID":"ff2c4a24-c817-4f0c-af19-31354f31095e","Type":"ContainerStarted","Data":"138016f62b09f58cbd355b2bc7f59d545c3ae8bb3e50adecc10030f246de1a42"} Jul 28 17:18:49.177324 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.177164 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:18:49.178532 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.178504 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" event={"ID":"aa9fef6c-9c3f-4587-9cf7-70010af70f49","Type":"ContainerStarted","Data":"87f0d5f1e7af4bcc0873e4934f519652eeb263a27483fbce2717a972ba38a43b"} Jul 28 17:18:49.178638 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.178623 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:18:49.195243 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.195183 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" podStartSLOduration=2.017212217 podStartE2EDuration="6.195168012s" totalImagesPullingTime="4.177955795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:49.194225386 +0000 UTC m=+490.542106334" watchObservedRunningTime="2026-07-28 17:18:49.195168012 +0000 UTC m=+490.543048945" Jul 28 17:18:49.212448 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.212399 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-2bwrc" podStartSLOduration=1.364746871 podStartE2EDuration="6.212382338s" totalImagesPullingTime="4.847635467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:49.211452205 +0000 UTC m=+490.559333138" watchObservedRunningTime="2026-07-28 17:18:49.212382338 +0000 UTC m=+490.560263269" Jul 28 17:18:49.233013 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:49.232958 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" podStartSLOduration=1.386746875 podStartE2EDuration="6.23294112s" totalImagesPullingTime="4.846194245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:49.23139113 +0000 UTC m=+490.579272061" watchObservedRunningTime="2026-07-28 17:18:49.23294112 +0000 UTC m=+490.580822051" Jul 28 17:18:55.186144 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:18:55.186110 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-2bwrc" Jul 28 17:19:20.185895 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:20.185860 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-r5wvs" Jul 28 17:19:20.189095 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:20.189068 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:19:28.073479 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.073446 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-vgttx"] Jul 28 17:19:28.073918 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.073644 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" podUID="3cc5b5e9-166e-42b0-872f-670a18cee469" containerName="manager" containerID="cri-o://55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c" gracePeriod=10 Jul 28 17:19:28.096772 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.096742 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-c9dr2"] Jul 28 17:19:28.099152 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.099126 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:28.111300 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.111269 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-c9dr2"] Jul 28 17:19:28.256322 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.256289 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd75l\" (UniqueName: \"kubernetes.io/projected/c33116ff-780f-44ba-b5d3-e48c916d5feb-kube-api-access-zd75l\") pod \"kserve-controller-manager-cd4d44c67-c9dr2\" (UID: \"c33116ff-780f-44ba-b5d3-e48c916d5feb\") " pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:28.256475 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.256328 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c33116ff-780f-44ba-b5d3-e48c916d5feb-cert\") pod \"kserve-controller-manager-cd4d44c67-c9dr2\" (UID: \"c33116ff-780f-44ba-b5d3-e48c916d5feb\") " pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:28.320243 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.320219 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:19:28.350754 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.350720 2570 generic.go:356] "Generic (PLEG): container finished" podID="3cc5b5e9-166e-42b0-872f-670a18cee469" containerID="55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c" exitCode=0 Jul 28 17:19:28.350934 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.350765 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" Jul 28 17:19:28.350934 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.350797 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" event={"ID":"3cc5b5e9-166e-42b0-872f-670a18cee469","Type":"ContainerDied","Data":"55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c"} Jul 28 17:19:28.350934 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.350874 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-vgttx" event={"ID":"3cc5b5e9-166e-42b0-872f-670a18cee469","Type":"ContainerDied","Data":"fda7cb6bd248158611d83daa2d6801caeb8d6959940a55e37e217f395f4f9a22"} Jul 28 17:19:28.350934 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.350899 2570 scope.go:117] "RemoveContainer" containerID="55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c" Jul 28 17:19:28.357082 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.357043 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd75l\" (UniqueName: \"kubernetes.io/projected/c33116ff-780f-44ba-b5d3-e48c916d5feb-kube-api-access-zd75l\") pod \"kserve-controller-manager-cd4d44c67-c9dr2\" (UID: \"c33116ff-780f-44ba-b5d3-e48c916d5feb\") " pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:28.357216 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.357096 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c33116ff-780f-44ba-b5d3-e48c916d5feb-cert\") pod \"kserve-controller-manager-cd4d44c67-c9dr2\" (UID: \"c33116ff-780f-44ba-b5d3-e48c916d5feb\") " pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:28.363418 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.359455 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c33116ff-780f-44ba-b5d3-e48c916d5feb-cert\") pod \"kserve-controller-manager-cd4d44c67-c9dr2\" (UID: \"c33116ff-780f-44ba-b5d3-e48c916d5feb\") " pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:28.365788 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.365678 2570 scope.go:117] "RemoveContainer" containerID="55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c" Jul 28 17:19:28.366258 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:19:28.366165 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c\": container with ID starting with 55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c not found: ID does not exist" containerID="55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c" Jul 28 17:19:28.366258 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.366214 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c"} err="failed to get container status \"55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c\": rpc error: code = NotFound desc = could not find container \"55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c\": container with ID starting with 55592b0d03f5be517c2fbd2611e0d07e3b75e63ddff83285a0775df22b864d9c not found: ID does not exist" Jul 28 17:19:28.368227 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.368202 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd75l\" (UniqueName: \"kubernetes.io/projected/c33116ff-780f-44ba-b5d3-e48c916d5feb-kube-api-access-zd75l\") pod \"kserve-controller-manager-cd4d44c67-c9dr2\" (UID: \"c33116ff-780f-44ba-b5d3-e48c916d5feb\") " pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:28.454791 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.454756 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:28.458562 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.458544 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk4fn\" (UniqueName: \"kubernetes.io/projected/3cc5b5e9-166e-42b0-872f-670a18cee469-kube-api-access-kk4fn\") pod \"3cc5b5e9-166e-42b0-872f-670a18cee469\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " Jul 28 17:19:28.458629 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.458588 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert\") pod \"3cc5b5e9-166e-42b0-872f-670a18cee469\" (UID: \"3cc5b5e9-166e-42b0-872f-670a18cee469\") " Jul 28 17:19:28.460757 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.460729 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc5b5e9-166e-42b0-872f-670a18cee469-kube-api-access-kk4fn" (OuterVolumeSpecName: "kube-api-access-kk4fn") pod "3cc5b5e9-166e-42b0-872f-670a18cee469" (UID: "3cc5b5e9-166e-42b0-872f-670a18cee469"). InnerVolumeSpecName "kube-api-access-kk4fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:19:28.460867 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.460733 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert" (OuterVolumeSpecName: "cert") pod "3cc5b5e9-166e-42b0-872f-670a18cee469" (UID: "3cc5b5e9-166e-42b0-872f-670a18cee469"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:19:28.559553 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.559517 2570 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cc5b5e9-166e-42b0-872f-670a18cee469-cert\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:19:28.559553 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.559554 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk4fn\" (UniqueName: \"kubernetes.io/projected/3cc5b5e9-166e-42b0-872f-670a18cee469-kube-api-access-kk4fn\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:19:28.582012 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.581989 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-c9dr2"] Jul 28 17:19:28.584137 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:19:28.584111 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33116ff_780f_44ba_b5d3_e48c916d5feb.slice/crio-2b7052c2cb9eb1ad6bfd3677bdbf6959c5435684c76e124d79f45afbbddc94e4 WatchSource:0}: Error finding container 2b7052c2cb9eb1ad6bfd3677bdbf6959c5435684c76e124d79f45afbbddc94e4: Status 404 returned error can't find the container with id 2b7052c2cb9eb1ad6bfd3677bdbf6959c5435684c76e124d79f45afbbddc94e4 Jul 28 17:19:28.673774 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.673744 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-vgttx"] Jul 28 17:19:28.678135 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:28.678109 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-vgttx"] Jul 28 17:19:29.225401 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:29.225368 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cc5b5e9-166e-42b0-872f-670a18cee469" path="/var/lib/kubelet/pods/3cc5b5e9-166e-42b0-872f-670a18cee469/volumes" Jul 28 17:19:29.357017 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:29.356985 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" event={"ID":"c33116ff-780f-44ba-b5d3-e48c916d5feb","Type":"ContainerStarted","Data":"8651a098e32fca62745737606fbadcbfea090d8357ca9db33d9715f23ef5e97c"} Jul 28 17:19:29.357206 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:29.357031 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" event={"ID":"c33116ff-780f-44ba-b5d3-e48c916d5feb","Type":"ContainerStarted","Data":"2b7052c2cb9eb1ad6bfd3677bdbf6959c5435684c76e124d79f45afbbddc94e4"} Jul 28 17:19:29.357206 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:29.357102 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:19:29.376316 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:19:29.376266 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" podStartSLOduration=0.801479397 podStartE2EDuration="1.376250242s" totalImagesPullingTime="574.770845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:19:29.374465103 +0000 UTC m=+530.722346035" watchObservedRunningTime="2026-07-28 17:19:29.376250242 +0000 UTC m=+530.724131174" Jul 28 17:20:00.366347 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:00.366313 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-cd4d44c67-c9dr2" Jul 28 17:20:01.399424 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.399371 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-7bwsr"] Jul 28 17:20:01.399898 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.399765 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc5b5e9-166e-42b0-872f-670a18cee469" containerName="manager" Jul 28 17:20:01.399898 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.399778 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc5b5e9-166e-42b0-872f-670a18cee469" containerName="manager" Jul 28 17:20:01.399898 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.399859 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc5b5e9-166e-42b0-872f-670a18cee469" containerName="manager" Jul 28 17:20:01.401934 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.401905 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:01.405073 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.405047 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-bfdcv\"" Jul 28 17:20:01.405366 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.405349 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 28 17:20:01.413349 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.413317 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-7bwsr"] Jul 28 17:20:01.512383 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.512348 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8nfc\" (UniqueName: \"kubernetes.io/projected/7bcbe427-8d25-492d-a849-9027d94b346c-kube-api-access-d8nfc\") pod \"odh-model-controller-75d9cdbddf-7bwsr\" (UID: \"7bcbe427-8d25-492d-a849-9027d94b346c\") " pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:01.512575 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.512410 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bcbe427-8d25-492d-a849-9027d94b346c-cert\") pod \"odh-model-controller-75d9cdbddf-7bwsr\" (UID: \"7bcbe427-8d25-492d-a849-9027d94b346c\") " pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:01.613488 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.613445 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8nfc\" (UniqueName: \"kubernetes.io/projected/7bcbe427-8d25-492d-a849-9027d94b346c-kube-api-access-d8nfc\") pod \"odh-model-controller-75d9cdbddf-7bwsr\" (UID: \"7bcbe427-8d25-492d-a849-9027d94b346c\") " pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:01.613668 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.613507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bcbe427-8d25-492d-a849-9027d94b346c-cert\") pod \"odh-model-controller-75d9cdbddf-7bwsr\" (UID: \"7bcbe427-8d25-492d-a849-9027d94b346c\") " pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:01.616002 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.615971 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bcbe427-8d25-492d-a849-9027d94b346c-cert\") pod \"odh-model-controller-75d9cdbddf-7bwsr\" (UID: \"7bcbe427-8d25-492d-a849-9027d94b346c\") " pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:01.622918 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.622894 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8nfc\" (UniqueName: \"kubernetes.io/projected/7bcbe427-8d25-492d-a849-9027d94b346c-kube-api-access-d8nfc\") pod \"odh-model-controller-75d9cdbddf-7bwsr\" (UID: \"7bcbe427-8d25-492d-a849-9027d94b346c\") " pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:01.712546 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.712452 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:01.845351 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:01.845325 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-7bwsr"] Jul 28 17:20:01.848111 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:20:01.848073 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bcbe427_8d25_492d_a849_9027d94b346c.slice/crio-da10e94345a3d688aa1814f7bb6b1e4ac93c9c7bcdae505ea3d989aaeecb16e9 WatchSource:0}: Error finding container da10e94345a3d688aa1814f7bb6b1e4ac93c9c7bcdae505ea3d989aaeecb16e9: Status 404 returned error can't find the container with id da10e94345a3d688aa1814f7bb6b1e4ac93c9c7bcdae505ea3d989aaeecb16e9 Jul 28 17:20:02.497662 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:02.497626 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" event={"ID":"7bcbe427-8d25-492d-a849-9027d94b346c","Type":"ContainerStarted","Data":"da10e94345a3d688aa1814f7bb6b1e4ac93c9c7bcdae505ea3d989aaeecb16e9"} Jul 28 17:20:05.515350 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:05.515315 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" event={"ID":"7bcbe427-8d25-492d-a849-9027d94b346c","Type":"ContainerStarted","Data":"06ed6d13e1fc1409b94c7d1568737898e5ba3695d4449acfdf97428ecc94ee03"} Jul 28 17:20:05.515745 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:05.515388 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:20:05.533711 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:05.533578 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" podStartSLOduration=1.854551368 podStartE2EDuration="4.533557359s" totalImagesPullingTime="2.679005991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:20:05.532742338 +0000 UTC m=+566.880623271" watchObservedRunningTime="2026-07-28 17:20:05.533557359 +0000 UTC m=+566.881438292" Jul 28 17:20:16.522866 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:20:16.522835 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-7bwsr" Jul 28 17:35:05.011249 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.011213 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74"] Jul 28 17:35:05.014748 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.014732 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.017319 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.017294 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 28 17:35:05.017443 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.017320 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 28 17:35:05.018604 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.018584 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Jul 28 17:35:05.018710 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.018636 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Jul 28 17:35:05.018775 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.018584 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 28 17:35:05.018862 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.018593 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-w2njn\"" Jul 28 17:35:05.018928 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.018584 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 17:35:05.024838 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.024817 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74"] Jul 28 17:35:05.182639 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.182602 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz26r\" (UniqueName: \"kubernetes.io/projected/736d6d36-11e3-4628-811b-f2b757113474-kube-api-access-fz26r\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.182854 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.182651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.182854 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.182716 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/736d6d36-11e3-4628-811b-f2b757113474-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.182854 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.182746 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.182854 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.182838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/736d6d36-11e3-4628-811b-f2b757113474-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.284175 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.284078 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.284175 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.284126 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/736d6d36-11e3-4628-811b-f2b757113474-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.284175 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.284146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.284456 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.284184 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/736d6d36-11e3-4628-811b-f2b757113474-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.284456 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.284213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz26r\" (UniqueName: \"kubernetes.io/projected/736d6d36-11e3-4628-811b-f2b757113474-kube-api-access-fz26r\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.284666 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.284646 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/736d6d36-11e3-4628-811b-f2b757113474-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.284913 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.284894 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.284990 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.284924 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.286611 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.286584 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/736d6d36-11e3-4628-811b-f2b757113474-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.292890 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.292868 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz26r\" (UniqueName: \"kubernetes.io/projected/736d6d36-11e3-4628-811b-f2b757113474-kube-api-access-fz26r\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-nbj74\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.326250 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.326212 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:05.460424 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.460398 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74"] Jul 28 17:35:05.466578 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:05.466560 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:35:06.305590 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:06.305553 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" event={"ID":"736d6d36-11e3-4628-811b-f2b757113474","Type":"ContainerStarted","Data":"4c808553f3e8fa32405a07eb8d997ad9126cdfb000f6b092c027812b67b0329a"} Jul 28 17:35:09.321244 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:09.321204 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" event={"ID":"736d6d36-11e3-4628-811b-f2b757113474","Type":"ContainerStarted","Data":"2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d"} Jul 28 17:35:13.339923 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:13.339886 2570 generic.go:356] "Generic (PLEG): container finished" podID="736d6d36-11e3-4628-811b-f2b757113474" containerID="2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d" exitCode=0 Jul 28 17:35:13.340349 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:13.339960 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" event={"ID":"736d6d36-11e3-4628-811b-f2b757113474","Type":"ContainerDied","Data":"2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d"} Jul 28 17:35:27.423032 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:27.422994 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" event={"ID":"736d6d36-11e3-4628-811b-f2b757113474","Type":"ContainerStarted","Data":"e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748"} Jul 28 17:35:30.439143 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:30.439110 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" event={"ID":"736d6d36-11e3-4628-811b-f2b757113474","Type":"ContainerStarted","Data":"236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569"} Jul 28 17:35:30.439598 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:30.439331 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:30.439598 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:30.439488 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:30.440646 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:30.440618 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:35:30.461121 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:30.461067 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podStartSLOduration=3.352406912 podStartE2EDuration="26.461051957s" totalImagesPullingTime="19.271371296s" totalInitContainerRuntime="3.837273749s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:30.459003272 +0000 UTC m=+1491.806884205" watchObservedRunningTime="2026-07-28 17:35:30.461051957 +0000 UTC m=+1491.808932888" Jul 28 17:35:31.443288 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:31.443245 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:35:36.448818 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:36.448774 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:35:36.449481 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:36.449441 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:35:46.450201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:46.450156 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:35:56.450096 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:35:56.450056 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:36:06.449859 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:06.449733 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:36:16.449708 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:16.449661 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:36:26.449935 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:26.449892 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:36:36.449785 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:36.449746 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 28 17:36:43.226769 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:43.226739 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:36:45.193952 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:45.193919 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74"] Jul 28 17:36:45.194392 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:45.194187 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" containerID="cri-o://e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748" gracePeriod=30 Jul 28 17:36:45.194454 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:45.194386 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kube-rbac-proxy" containerID="cri-o://236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569" gracePeriod=30 Jul 28 17:36:45.762986 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:45.762956 2570 generic.go:356] "Generic (PLEG): container finished" podID="736d6d36-11e3-4628-811b-f2b757113474" containerID="236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569" exitCode=2 Jul 28 17:36:45.763155 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:45.762996 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" event={"ID":"736d6d36-11e3-4628-811b-f2b757113474","Type":"ContainerDied","Data":"236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569"} Jul 28 17:36:46.443953 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:46.443910 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused" Jul 28 17:36:50.144202 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.144174 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:36:50.268792 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.268700 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-cabundle-cert\") pod \"736d6d36-11e3-4628-811b-f2b757113474\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " Jul 28 17:36:50.268792 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.268745 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/736d6d36-11e3-4628-811b-f2b757113474-proxy-tls\") pod \"736d6d36-11e3-4628-811b-f2b757113474\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " Jul 28 17:36:50.268792 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.268796 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz26r\" (UniqueName: \"kubernetes.io/projected/736d6d36-11e3-4628-811b-f2b757113474-kube-api-access-fz26r\") pod \"736d6d36-11e3-4628-811b-f2b757113474\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " Jul 28 17:36:50.269080 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.268898 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-kube-rbac-proxy-sar-config\") pod \"736d6d36-11e3-4628-811b-f2b757113474\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " Jul 28 17:36:50.269080 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.268926 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/736d6d36-11e3-4628-811b-f2b757113474-kserve-provision-location\") pod \"736d6d36-11e3-4628-811b-f2b757113474\" (UID: \"736d6d36-11e3-4628-811b-f2b757113474\") " Jul 28 17:36:50.269180 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.269147 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "736d6d36-11e3-4628-811b-f2b757113474" (UID: "736d6d36-11e3-4628-811b-f2b757113474"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:36:50.269544 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.269514 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736d6d36-11e3-4628-811b-f2b757113474-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "736d6d36-11e3-4628-811b-f2b757113474" (UID: "736d6d36-11e3-4628-811b-f2b757113474"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:36:50.269702 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.269571 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "736d6d36-11e3-4628-811b-f2b757113474" (UID: "736d6d36-11e3-4628-811b-f2b757113474"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:36:50.270269 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.269865 2570 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-cabundle-cert\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:36:50.271627 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.271566 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736d6d36-11e3-4628-811b-f2b757113474-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "736d6d36-11e3-4628-811b-f2b757113474" (UID: "736d6d36-11e3-4628-811b-f2b757113474"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:36:50.272026 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.271998 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736d6d36-11e3-4628-811b-f2b757113474-kube-api-access-fz26r" (OuterVolumeSpecName: "kube-api-access-fz26r") pod "736d6d36-11e3-4628-811b-f2b757113474" (UID: "736d6d36-11e3-4628-811b-f2b757113474"). InnerVolumeSpecName "kube-api-access-fz26r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:36:50.371018 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.370984 2570 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/736d6d36-11e3-4628-811b-f2b757113474-proxy-tls\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:36:50.371018 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.371012 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz26r\" (UniqueName: \"kubernetes.io/projected/736d6d36-11e3-4628-811b-f2b757113474-kube-api-access-fz26r\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:36:50.371018 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.371026 2570 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/736d6d36-11e3-4628-811b-f2b757113474-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:36:50.371252 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.371040 2570 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/736d6d36-11e3-4628-811b-f2b757113474-kserve-provision-location\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:36:50.788646 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.788612 2570 generic.go:356] "Generic (PLEG): container finished" podID="736d6d36-11e3-4628-811b-f2b757113474" containerID="e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748" exitCode=0 Jul 28 17:36:50.788823 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.788669 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" Jul 28 17:36:50.788823 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.788694 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" event={"ID":"736d6d36-11e3-4628-811b-f2b757113474","Type":"ContainerDied","Data":"e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748"} Jul 28 17:36:50.788823 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.788776 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74" event={"ID":"736d6d36-11e3-4628-811b-f2b757113474","Type":"ContainerDied","Data":"4c808553f3e8fa32405a07eb8d997ad9126cdfb000f6b092c027812b67b0329a"} Jul 28 17:36:50.788961 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.788828 2570 scope.go:117] "RemoveContainer" containerID="236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569" Jul 28 17:36:50.798257 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.798239 2570 scope.go:117] "RemoveContainer" containerID="e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748" Jul 28 17:36:50.806636 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.806616 2570 scope.go:117] "RemoveContainer" containerID="2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d" Jul 28 17:36:50.814274 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.814251 2570 scope.go:117] "RemoveContainer" containerID="236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569" Jul 28 17:36:50.814577 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:36:50.814557 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569\": container with ID starting with 236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569 not found: ID does not exist" containerID="236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569" Jul 28 17:36:50.814644 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.814595 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569"} err="failed to get container status \"236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569\": rpc error: code = NotFound desc = could not find container \"236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569\": container with ID starting with 236112fd1894a96945bfad78db24ceeb2b3430ca3a752c64a3cf526c9d020569 not found: ID does not exist" Jul 28 17:36:50.814644 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.814617 2570 scope.go:117] "RemoveContainer" containerID="e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748" Jul 28 17:36:50.814893 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:36:50.814873 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748\": container with ID starting with e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748 not found: ID does not exist" containerID="e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748" Jul 28 17:36:50.814945 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.814900 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748"} err="failed to get container status \"e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748\": rpc error: code = NotFound desc = could not find container \"e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748\": container with ID starting with e54c6714c5e988553ecbf24e1025dde06c6a9ec220a30b2fdc02334b57353748 not found: ID does not exist" Jul 28 17:36:50.814945 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.814916 2570 scope.go:117] "RemoveContainer" containerID="2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d" Jul 28 17:36:50.815144 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:36:50.815128 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d\": container with ID starting with 2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d not found: ID does not exist" containerID="2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d" Jul 28 17:36:50.815181 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.815152 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d"} err="failed to get container status \"2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d\": rpc error: code = NotFound desc = could not find container \"2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d\": container with ID starting with 2994a560db79768fdb7f9fac514a4bfbc908a356f3768073f4a4b1433c1c7e5d not found: ID does not exist" Jul 28 17:36:50.819152 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.819130 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74"] Jul 28 17:36:50.830925 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:50.830896 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-nbj74"] Jul 28 17:36:51.226391 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:36:51.226360 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="736d6d36-11e3-4628-811b-f2b757113474" path="/var/lib/kubelet/pods/736d6d36-11e3-4628-811b-f2b757113474/volumes" Jul 28 17:38:20.457256 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457220 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp"] Jul 28 17:38:20.457724 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457599 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kube-rbac-proxy" Jul 28 17:38:20.457724 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457614 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kube-rbac-proxy" Jul 28 17:38:20.457724 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457631 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" Jul 28 17:38:20.457724 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457637 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" Jul 28 17:38:20.457724 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457648 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="storage-initializer" Jul 28 17:38:20.457724 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457653 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="storage-initializer" Jul 28 17:38:20.457724 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457703 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kube-rbac-proxy" Jul 28 17:38:20.457724 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.457713 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="736d6d36-11e3-4628-811b-f2b757113474" containerName="kserve-container" Jul 28 17:38:20.460722 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.460707 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.463621 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.463599 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 17:38:20.463621 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.463612 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 28 17:38:20.463815 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.463651 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 28 17:38:20.463936 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.463922 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Jul 28 17:38:20.463990 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.463975 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 28 17:38:20.464874 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.464855 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-w2njn\"" Jul 28 17:38:20.465013 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.464900 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\"" Jul 28 17:38:20.471525 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.471503 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp"] Jul 28 17:38:20.532020 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.531988 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-cabundle-cert\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.532188 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.532028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.532188 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.532060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae9aafce-02d9-482b-bfc9-e165c90e44b2-proxy-tls\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.532188 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.532108 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.532307 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.532188 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnlq5\" (UniqueName: \"kubernetes.io/projected/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-api-access-wnlq5\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.632578 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.632544 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnlq5\" (UniqueName: \"kubernetes.io/projected/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-api-access-wnlq5\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.632759 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.632592 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-cabundle-cert\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.632759 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.632628 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.632759 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.632653 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae9aafce-02d9-482b-bfc9-e165c90e44b2-proxy-tls\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.632759 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.632705 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.633113 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.633093 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.633332 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.633311 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-cabundle-cert\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.633401 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.633371 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.635129 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.635110 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae9aafce-02d9-482b-bfc9-e165c90e44b2-proxy-tls\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.640877 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.640854 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnlq5\" (UniqueName: \"kubernetes.io/projected/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-api-access-wnlq5\") pod \"isvc-canary-rollback-predictor-b4645bb5c-8qbjp\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.771718 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.771625 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:20.902824 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:20.902740 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp"] Jul 28 17:38:20.905602 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:38:20.905576 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9aafce_02d9_482b_bfc9_e165c90e44b2.slice/crio-3ac839b750546974db72a3d7387cab933afb90da6d7c3e1c18e2621e036c53e2 WatchSource:0}: Error finding container 3ac839b750546974db72a3d7387cab933afb90da6d7c3e1c18e2621e036c53e2: Status 404 returned error can't find the container with id 3ac839b750546974db72a3d7387cab933afb90da6d7c3e1c18e2621e036c53e2 Jul 28 17:38:21.182092 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:21.182052 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" event={"ID":"ae9aafce-02d9-482b-bfc9-e165c90e44b2","Type":"ContainerStarted","Data":"76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee"} Jul 28 17:38:21.182271 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:21.182120 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" event={"ID":"ae9aafce-02d9-482b-bfc9-e165c90e44b2","Type":"ContainerStarted","Data":"3ac839b750546974db72a3d7387cab933afb90da6d7c3e1c18e2621e036c53e2"} Jul 28 17:38:25.200684 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:25.200649 2570 generic.go:356] "Generic (PLEG): container finished" podID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerID="76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee" exitCode=0 Jul 28 17:38:25.201083 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:25.200723 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" event={"ID":"ae9aafce-02d9-482b-bfc9-e165c90e44b2","Type":"ContainerDied","Data":"76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee"} Jul 28 17:38:26.208055 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:26.208019 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" event={"ID":"ae9aafce-02d9-482b-bfc9-e165c90e44b2","Type":"ContainerStarted","Data":"b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e"} Jul 28 17:38:26.208446 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:26.208079 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" event={"ID":"ae9aafce-02d9-482b-bfc9-e165c90e44b2","Type":"ContainerStarted","Data":"9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d"} Jul 28 17:38:26.208446 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:26.208345 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:26.208547 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:26.208483 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:26.209867 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:26.209842 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:38:26.232014 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:26.231959 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podStartSLOduration=2.402260624 podStartE2EDuration="6.231941429s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.829680805s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:38:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:38:26.230553431 +0000 UTC m=+1667.578434377" watchObservedRunningTime="2026-07-28 17:38:26.231941429 +0000 UTC m=+1667.579822406" Jul 28 17:38:27.212881 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:27.212843 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:38:32.218069 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:32.218039 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:38:32.218597 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:32.218560 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:38:42.219084 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:42.219048 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:38:52.219132 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:38:52.219091 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:39:02.218840 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:02.218741 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:39:12.219126 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:12.219078 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:39:22.218705 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:22.218667 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:39:32.218757 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:32.218715 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:39:42.219980 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:42.219952 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:39:50.600930 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:50.600891 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp"] Jul 28 17:39:50.601348 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:50.601144 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" containerID="cri-o://9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d" gracePeriod=30 Jul 28 17:39:50.601348 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:50.601241 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kube-rbac-proxy" containerID="cri-o://b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e" gracePeriod=30 Jul 28 17:39:51.577409 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:51.577373 2570 generic.go:356] "Generic (PLEG): container finished" podID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerID="b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e" exitCode=2 Jul 28 17:39:51.577588 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:51.577447 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" event={"ID":"ae9aafce-02d9-482b-bfc9-e165c90e44b2","Type":"ContainerDied","Data":"b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e"} Jul 28 17:39:52.213535 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:52.213499 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.26:8643/healthz\": dial tcp 10.133.0.26:8643: connect: connection refused" Jul 28 17:39:52.219353 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:52.219324 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 28 17:39:55.347693 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.347662 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:39:55.434561 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.434458 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnlq5\" (UniqueName: \"kubernetes.io/projected/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-api-access-wnlq5\") pod \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " Jul 28 17:39:55.434561 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.434523 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kserve-provision-location\") pod \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " Jul 28 17:39:55.434787 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.434601 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-rbac-proxy-sar-config\") pod \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " Jul 28 17:39:55.434787 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.434632 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae9aafce-02d9-482b-bfc9-e165c90e44b2-proxy-tls\") pod \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " Jul 28 17:39:55.434787 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.434660 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-cabundle-cert\") pod \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\" (UID: \"ae9aafce-02d9-482b-bfc9-e165c90e44b2\") " Jul 28 17:39:55.434973 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.434901 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ae9aafce-02d9-482b-bfc9-e165c90e44b2" (UID: "ae9aafce-02d9-482b-bfc9-e165c90e44b2"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:39:55.435055 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.434956 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ae9aafce-02d9-482b-bfc9-e165c90e44b2" (UID: "ae9aafce-02d9-482b-bfc9-e165c90e44b2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:39:55.435092 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.435074 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "ae9aafce-02d9-482b-bfc9-e165c90e44b2" (UID: "ae9aafce-02d9-482b-bfc9-e165c90e44b2"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:39:55.436582 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.436557 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-api-access-wnlq5" (OuterVolumeSpecName: "kube-api-access-wnlq5") pod "ae9aafce-02d9-482b-bfc9-e165c90e44b2" (UID: "ae9aafce-02d9-482b-bfc9-e165c90e44b2"). InnerVolumeSpecName "kube-api-access-wnlq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:39:55.436682 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.436575 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae9aafce-02d9-482b-bfc9-e165c90e44b2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ae9aafce-02d9-482b-bfc9-e165c90e44b2" (UID: "ae9aafce-02d9-482b-bfc9-e165c90e44b2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:39:55.535389 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.535357 2570 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kserve-provision-location\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:39:55.535389 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.535383 2570 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:39:55.535389 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.535395 2570 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae9aafce-02d9-482b-bfc9-e165c90e44b2-proxy-tls\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:39:55.535615 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.535404 2570 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae9aafce-02d9-482b-bfc9-e165c90e44b2-cabundle-cert\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:39:55.535615 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.535412 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnlq5\" (UniqueName: \"kubernetes.io/projected/ae9aafce-02d9-482b-bfc9-e165c90e44b2-kube-api-access-wnlq5\") on node \"ip-10-0-134-178.ec2.internal\" DevicePath \"\"" Jul 28 17:39:55.598680 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.598648 2570 generic.go:356] "Generic (PLEG): container finished" podID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerID="9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d" exitCode=0 Jul 28 17:39:55.598844 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.598707 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" Jul 28 17:39:55.598844 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.598732 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" event={"ID":"ae9aafce-02d9-482b-bfc9-e165c90e44b2","Type":"ContainerDied","Data":"9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d"} Jul 28 17:39:55.598844 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.598793 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp" event={"ID":"ae9aafce-02d9-482b-bfc9-e165c90e44b2","Type":"ContainerDied","Data":"3ac839b750546974db72a3d7387cab933afb90da6d7c3e1c18e2621e036c53e2"} Jul 28 17:39:55.598844 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.598827 2570 scope.go:117] "RemoveContainer" containerID="b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e" Jul 28 17:39:55.608289 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.608268 2570 scope.go:117] "RemoveContainer" containerID="9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d" Jul 28 17:39:55.615951 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.615930 2570 scope.go:117] "RemoveContainer" containerID="76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee" Jul 28 17:39:55.623792 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.623774 2570 scope.go:117] "RemoveContainer" containerID="b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e" Jul 28 17:39:55.624096 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:39:55.624075 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e\": container with ID starting with b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e not found: ID does not exist" containerID="b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e" Jul 28 17:39:55.624146 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.624105 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e"} err="failed to get container status \"b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e\": rpc error: code = NotFound desc = could not find container \"b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e\": container with ID starting with b59e553a6398ac3f4bcbdf110d64b7cd6bc0a9330bb468a7937b7b235d97d98e not found: ID does not exist" Jul 28 17:39:55.624146 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.624122 2570 scope.go:117] "RemoveContainer" containerID="9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d" Jul 28 17:39:55.624402 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:39:55.624382 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d\": container with ID starting with 9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d not found: ID does not exist" containerID="9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d" Jul 28 17:39:55.624474 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.624408 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d"} err="failed to get container status \"9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d\": rpc error: code = NotFound desc = could not find container \"9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d\": container with ID starting with 9b0f57867bab53083670c266d4e084d560aa52d316623d64cedc215d5a5b9b1d not found: ID does not exist" Jul 28 17:39:55.624474 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.624423 2570 scope.go:117] "RemoveContainer" containerID="76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee" Jul 28 17:39:55.624724 ip-10-0-134-178 kubenswrapper[2570]: E0728 17:39:55.624704 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee\": container with ID starting with 76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee not found: ID does not exist" containerID="76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee" Jul 28 17:39:55.624782 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.624729 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee"} err="failed to get container status \"76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee\": rpc error: code = NotFound desc = could not find container \"76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee\": container with ID starting with 76a73536ad7acf37c03b554cc94ba470cc4a1297d7c67cb1c415bc61226651ee not found: ID does not exist" Jul 28 17:39:55.624961 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.624941 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp"] Jul 28 17:39:55.629675 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:55.629650 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-8qbjp"] Jul 28 17:39:57.226472 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:39:57.226441 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" path="/var/lib/kubelet/pods/ae9aafce-02d9-482b-bfc9-e165c90e44b2/volumes" Jul 28 17:47:21.980712 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:21.980679 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-227qv_58620e3a-8378-46e5-9d7a-aaf8e78edf6b/global-pull-secret-syncer/0.log" Jul 28 17:47:22.174123 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:22.174093 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kb9wj_d3113a92-c6d2-46c4-99fe-94d1e5bb6fab/konnectivity-agent/0.log" Jul 28 17:47:22.228403 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:22.228373 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-178.ec2.internal_802e94b6ca2fdea2f3a6672231023aac/haproxy/0.log" Jul 28 17:47:26.203168 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.203097 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-89gv6_77210d4b-8a15-4440-8eb0-7e2f143dedd6/kube-state-metrics/0.log" Jul 28 17:47:26.228440 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.228410 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-89gv6_77210d4b-8a15-4440-8eb0-7e2f143dedd6/kube-rbac-proxy-main/0.log" Jul 28 17:47:26.247321 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.247296 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-89gv6_77210d4b-8a15-4440-8eb0-7e2f143dedd6/kube-rbac-proxy-self/0.log" Jul 28 17:47:26.320383 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.320353 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-llkhj_a941163c-a5ee-4e18-b59d-d6436be35d81/monitoring-plugin/0.log" Jul 28 17:47:26.445500 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.445471 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxq6d_700cd7ae-3574-4191-a379-72b399377322/node-exporter/0.log" Jul 28 17:47:26.466239 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.466151 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxq6d_700cd7ae-3574-4191-a379-72b399377322/kube-rbac-proxy/0.log" Jul 28 17:47:26.484997 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.484969 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxq6d_700cd7ae-3574-4191-a379-72b399377322/init-textfile/0.log" Jul 28 17:47:26.652376 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.652344 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ht4qf_299b3c56-73aa-46e5-88af-7d5a07736c5e/kube-rbac-proxy-main/0.log" Jul 28 17:47:26.679787 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.679760 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ht4qf_299b3c56-73aa-46e5-88af-7d5a07736c5e/kube-rbac-proxy-self/0.log" Jul 28 17:47:26.699737 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:26.699710 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ht4qf_299b3c56-73aa-46e5-88af-7d5a07736c5e/openshift-state-metrics/0.log" Jul 28 17:47:27.002027 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.002002 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65d4857c-vh4zs_aba2ef3b-e172-45b9-9217-8115c1bc9ffb/telemeter-client/0.log" Jul 28 17:47:27.027473 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.027446 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65d4857c-vh4zs_aba2ef3b-e172-45b9-9217-8115c1bc9ffb/reload/0.log" Jul 28 17:47:27.052033 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.051997 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65d4857c-vh4zs_aba2ef3b-e172-45b9-9217-8115c1bc9ffb/kube-rbac-proxy/0.log" Jul 28 17:47:27.091679 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.091645 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b77c7dd89-rn8qv_e5304b71-b487-4245-8bf1-aefc36b0ba9d/thanos-query/0.log" Jul 28 17:47:27.110494 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.110457 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b77c7dd89-rn8qv_e5304b71-b487-4245-8bf1-aefc36b0ba9d/kube-rbac-proxy-web/0.log" Jul 28 17:47:27.138178 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.138141 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b77c7dd89-rn8qv_e5304b71-b487-4245-8bf1-aefc36b0ba9d/kube-rbac-proxy/0.log" Jul 28 17:47:27.161450 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.161422 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b77c7dd89-rn8qv_e5304b71-b487-4245-8bf1-aefc36b0ba9d/prom-label-proxy/0.log" Jul 28 17:47:27.179872 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.179845 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b77c7dd89-rn8qv_e5304b71-b487-4245-8bf1-aefc36b0ba9d/kube-rbac-proxy-rules/0.log" Jul 28 17:47:27.207952 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:27.207924 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b77c7dd89-rn8qv_e5304b71-b487-4245-8bf1-aefc36b0ba9d/kube-rbac-proxy-metrics/0.log" Jul 28 17:47:30.243948 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.243913 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56"] Jul 28 17:47:30.244323 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.244221 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" Jul 28 17:47:30.244323 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.244232 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" Jul 28 17:47:30.244323 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.244241 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kube-rbac-proxy" Jul 28 17:47:30.244323 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.244248 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kube-rbac-proxy" Jul 28 17:47:30.244323 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.244259 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="storage-initializer" Jul 28 17:47:30.244323 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.244265 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="storage-initializer" Jul 28 17:47:30.244510 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.244349 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kube-rbac-proxy" Jul 28 17:47:30.244510 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.244358 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9aafce-02d9-482b-bfc9-e165c90e44b2" containerName="kserve-container" Jul 28 17:47:30.247432 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.247408 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.250723 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.250706 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ff2pm\"/\"default-dockercfg-9nldz\"" Jul 28 17:47:30.250822 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.250792 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ff2pm\"/\"openshift-service-ca.crt\"" Jul 28 17:47:30.250882 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.250795 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ff2pm\"/\"kube-root-ca.crt\"" Jul 28 17:47:30.257521 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.257501 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56"] Jul 28 17:47:30.388474 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.388426 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-lib-modules\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.388474 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.388495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-proc\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.388723 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.388545 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-podres\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.388723 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.388565 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-sys\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.388723 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.388608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlq2f\" (UniqueName: \"kubernetes.io/projected/d02bb543-7c6b-4856-b348-df5a5bd86f22-kube-api-access-xlq2f\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489468 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489414 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-podres\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489468 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489469 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-sys\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489496 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlq2f\" (UniqueName: \"kubernetes.io/projected/d02bb543-7c6b-4856-b348-df5a5bd86f22-kube-api-access-xlq2f\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489562 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-lib-modules\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489566 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-sys\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489584 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-podres\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489641 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-proc\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489687 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-lib-modules\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.489726 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.489698 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d02bb543-7c6b-4856-b348-df5a5bd86f22-proc\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.499058 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.499003 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlq2f\" (UniqueName: \"kubernetes.io/projected/d02bb543-7c6b-4856-b348-df5a5bd86f22-kube-api-access-xlq2f\") pod \"perf-node-gather-daemonset-4zl56\" (UID: \"d02bb543-7c6b-4856-b348-df5a5bd86f22\") " pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.557688 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.557659 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:30.687153 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.687126 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56"] Jul 28 17:47:30.689180 ip-10-0-134-178 kubenswrapper[2570]: W0728 17:47:30.689153 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd02bb543_7c6b_4856_b348_df5a5bd86f22.slice/crio-1f7dcb45fc3aa6d88ac000c11b3ac6ec07887fb2fc7480daf7de2b043ba302fd WatchSource:0}: Error finding container 1f7dcb45fc3aa6d88ac000c11b3ac6ec07887fb2fc7480daf7de2b043ba302fd: Status 404 returned error can't find the container with id 1f7dcb45fc3aa6d88ac000c11b3ac6ec07887fb2fc7480daf7de2b043ba302fd Jul 28 17:47:30.997520 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:30.997488 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8hvvq_1776fe27-b08e-47be-a86f-b033fc89f81a/dns/0.log" Jul 28 17:47:31.021229 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:31.021159 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8hvvq_1776fe27-b08e-47be-a86f-b033fc89f81a/kube-rbac-proxy/0.log" Jul 28 17:47:31.161350 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:31.161317 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tvjwr_aa48fe6a-6d93-4b17-b269-4e26f1d11c05/dns-node-resolver/0.log" Jul 28 17:47:31.523258 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:31.523226 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" event={"ID":"d02bb543-7c6b-4856-b348-df5a5bd86f22","Type":"ContainerStarted","Data":"f4f12869ef9dd0abdd7fbf1a8df64fdada73b73ec630d54168a04583debaca30"} Jul 28 17:47:31.523643 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:31.523274 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" event={"ID":"d02bb543-7c6b-4856-b348-df5a5bd86f22","Type":"ContainerStarted","Data":"1f7dcb45fc3aa6d88ac000c11b3ac6ec07887fb2fc7480daf7de2b043ba302fd"} Jul 28 17:47:31.523643 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:31.523360 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:31.542654 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:31.542606 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" podStartSLOduration=1.542590883 podStartE2EDuration="1.542590883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:47:31.541971455 +0000 UTC m=+2212.889852387" watchObservedRunningTime="2026-07-28 17:47:31.542590883 +0000 UTC m=+2212.890471815" Jul 28 17:47:31.660254 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:31.660198 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dc7b9d64d-c24wq_9ca7b17f-0ab9-4870-8d72-3c7aaf0a0f43/registry/0.log" Jul 28 17:47:31.739895 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:31.739866 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n7mrd_af54ed7f-261b-4812-9c63-0ec01331f266/node-ca/0.log" Jul 28 17:47:32.811440 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:32.811409 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2shdc_5acd1fa5-910f-4598-8344-5808f48f1cca/serve-healthcheck-canary/0.log" Jul 28 17:47:33.450190 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:33.450160 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qsffg_d6bf4e1c-2ab0-4648-b148-e28cfc944537/kube-rbac-proxy/0.log" Jul 28 17:47:33.471676 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:33.471652 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qsffg_d6bf4e1c-2ab0-4648-b148-e28cfc944537/exporter/0.log" Jul 28 17:47:33.492414 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:33.492383 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qsffg_d6bf4e1c-2ab0-4648-b148-e28cfc944537/extractor/0.log" Jul 28 17:47:35.710596 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:35.710552 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-cd4d44c67-c9dr2_c33116ff-780f-44ba-b5d3-e48c916d5feb/manager/0.log" Jul 28 17:47:35.745857 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:35.745826 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-r5wvs_aa9fef6c-9c3f-4587-9cf7-70010af70f49/manager/0.log" Jul 28 17:47:35.966003 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:35.965919 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-7bwsr_7bcbe427-8d25-492d-a849-9027d94b346c/manager/0.log" Jul 28 17:47:36.048162 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:36.048135 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-2bwrc_ff2c4a24-c817-4f0c-af19-31354f31095e/seaweedfs/0.log" Jul 28 17:47:37.537334 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:37.537307 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ff2pm/perf-node-gather-daemonset-4zl56" Jul 28 17:47:41.858236 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:41.858209 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbgc_19a27f5c-91b5-4084-85b4-7458623dc52a/kube-multus-additional-cni-plugins/0.log" Jul 28 17:47:41.877708 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:41.877681 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbgc_19a27f5c-91b5-4084-85b4-7458623dc52a/egress-router-binary-copy/0.log" Jul 28 17:47:41.896534 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:41.896503 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbgc_19a27f5c-91b5-4084-85b4-7458623dc52a/cni-plugins/0.log" Jul 28 17:47:41.915047 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:41.915019 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbgc_19a27f5c-91b5-4084-85b4-7458623dc52a/bond-cni-plugin/0.log" Jul 28 17:47:41.933416 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:41.933390 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbgc_19a27f5c-91b5-4084-85b4-7458623dc52a/routeoverride-cni/0.log" Jul 28 17:47:41.951746 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:41.951715 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbgc_19a27f5c-91b5-4084-85b4-7458623dc52a/whereabouts-cni-bincopy/0.log" Jul 28 17:47:41.970383 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:41.970354 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbgc_19a27f5c-91b5-4084-85b4-7458623dc52a/whereabouts-cni/0.log" Jul 28 17:47:41.998201 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:41.998169 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cqt2f_e867cc7b-e212-4f81-b221-c346948ec4a0/kube-multus/0.log" Jul 28 17:47:42.070640 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:42.070606 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bbztf_e94fa4fc-230d-4bca-91da-de6bae60cb56/network-metrics-daemon/0.log" Jul 28 17:47:42.089170 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:42.089146 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bbztf_e94fa4fc-230d-4bca-91da-de6bae60cb56/kube-rbac-proxy/0.log" Jul 28 17:47:42.902532 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:42.902502 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnt2g_aacd0446-d9ac-4f0a-be87-d48f388d24d8/ovn-controller/0.log" Jul 28 17:47:42.920480 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:42.920447 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnt2g_aacd0446-d9ac-4f0a-be87-d48f388d24d8/ovn-acl-logging/0.log" Jul 28 17:47:42.941561 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:42.941536 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnt2g_aacd0446-d9ac-4f0a-be87-d48f388d24d8/kube-rbac-proxy-node/0.log" Jul 28 17:47:42.961708 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:42.961676 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnt2g_aacd0446-d9ac-4f0a-be87-d48f388d24d8/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 17:47:42.978920 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:42.978886 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnt2g_aacd0446-d9ac-4f0a-be87-d48f388d24d8/northd/0.log" Jul 28 17:47:43.001414 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:43.001386 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnt2g_aacd0446-d9ac-4f0a-be87-d48f388d24d8/nbdb/0.log" Jul 28 17:47:43.021529 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:43.021494 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnt2g_aacd0446-d9ac-4f0a-be87-d48f388d24d8/sbdb/0.log" Jul 28 17:47:43.082264 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:43.082230 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnt2g_aacd0446-d9ac-4f0a-be87-d48f388d24d8/ovnkube-controller/0.log" Jul 28 17:47:44.544123 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:44.544093 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mlskw_2b9c67ba-8430-44b2-8779-aa136c0c6f17/network-check-target-container/0.log" Jul 28 17:47:45.561661 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:45.561628 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-pvd2h_e5234cca-d671-40ff-b9cd-e4e184221349/iptables-alerter/0.log" Jul 28 17:47:46.324104 ip-10-0-134-178 kubenswrapper[2570]: I0728 17:47:46.324072 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lldlc_06ba6b63-6e18-4226-b614-cd94fb74026a/tuned/0.log"