Jul 06 20:14:47.537859 ip-10-0-136-202 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.955984 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963622 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963635 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963640 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963649 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963655 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963661 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963665 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:14:48.017501 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963669 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963673 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963677 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963681 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963687 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963694 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963699 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963716 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963722 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963727 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963732 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963737 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963742 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963746 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963750 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963755 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963760 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963788 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963808 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:14:48.019504 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963922 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963930 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963934 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963938 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963942 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963946 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963950 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963955 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963959 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963963 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963969 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963973 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963977 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963982 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963985 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963989 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963993 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.963997 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964003 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:14:48.021853 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964008 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964012 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964015 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964020 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964024 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964028 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964032 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964036 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964039 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964043 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964048 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964052 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964056 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964066 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964071 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964075 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964078 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964082 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964086 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964090 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:14:48.034934 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964093 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964098 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964102 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964105 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964109 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964113 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964117 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964121 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964125 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964128 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964132 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964135 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964139 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964143 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964149 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964153 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964157 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964160 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964164 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964168 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:14:48.038105 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964171 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964175 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964178 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964182 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964186 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964192 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964198 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964202 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964206 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964210 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964214 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964218 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964222 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.964226 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965206 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965215 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965219 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965223 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965227 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965231 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:14:48.040827 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965234 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965238 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965242 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965247 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965251 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965255 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965258 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965262 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965269 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965272 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965276 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965280 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965285 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965289 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965294 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965298 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965301 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965305 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965309 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965313 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:14:48.042952 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965317 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965321 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965325 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965329 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965333 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965338 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965342 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965345 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965349 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965352 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965356 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965360 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965364 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965369 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965372 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965376 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965379 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965383 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965387 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965391 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:14:48.043781 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965396 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965400 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965404 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965407 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965413 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965417 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965420 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965424 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965427 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965431 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965435 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965439 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965443 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965446 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965450 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965454 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965459 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965465 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965470 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965474 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:14:48.046126 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965480 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965485 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965491 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965494 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965498 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965502 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965507 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965512 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965515 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965519 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965522 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965526 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965533 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965536 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965540 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965544 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965547 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965552 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965575 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:14:48.047284 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965580 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965584 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965588 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965594 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965600 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965604 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965608 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965611 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965616 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965620 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965624 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965627 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965631 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.965636 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966221 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966229 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966234 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966238 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966242 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:14:48.049314 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966247 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:14:48.047986 ip-10-0-136-202 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966251 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966255 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966259 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966263 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966267 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966272 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966276 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966282 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966287 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966291 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966296 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966300 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966304 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966308 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966313 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966317 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966321 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966324 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:14:48.053090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966328 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966332 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966336 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966340 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966343 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966347 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966351 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966356 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966360 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966364 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966367 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966371 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966375 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966378 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966383 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966386 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966390 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966394 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966397 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966402 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:14:48.054260 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966408 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966414 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966419 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966423 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966427 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966432 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966436 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966439 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966443 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966447 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966451 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966456 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966459 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966463 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966471 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966476 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966481 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966485 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966488 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:14:48.061609 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966494 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966497 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966501 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966505 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966509 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966513 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966517 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966520 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966525 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966529 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966533 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966537 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966542 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966545 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966549 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966553 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966571 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966574 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966578 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:14:48.062437 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966582 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966587 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966591 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966594 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966598 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966601 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966605 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966609 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966612 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966616 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966620 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966624 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966628 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966633 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966637 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966641 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.966645 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966725 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966733 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966741 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966747 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:14:48.063090 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966752 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966757 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966763 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966769 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966775 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966779 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966784 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966789 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966793 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966798 2559 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966801 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966805 2559 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966810 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966814 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966820 2559 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966824 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966828 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966833 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966837 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966843 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966848 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966851 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966856 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966861 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:14:48.063928 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966870 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966874 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966879 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966882 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966888 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966892 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966897 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966901 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966906 2559 flags.go:64] FLAG: --enable-server="true" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966910 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966916 2559 flags.go:64] FLAG: --event-burst="100" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966920 2559 flags.go:64] FLAG: --event-qps="50" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966927 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966931 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966935 2559 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966941 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966945 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966950 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966954 2559 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966958 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966962 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966967 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966971 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966976 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966980 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:14:48.064978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966984 2559 flags.go:64] FLAG: --feature-gates="" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966989 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966994 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.966998 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967003 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967007 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967011 2559 flags.go:64] FLAG: --help="false" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967017 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967022 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967026 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967030 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967034 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967039 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967043 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967047 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967051 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967055 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967059 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967063 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967069 2559 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967074 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967078 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967082 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967086 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:14:48.065815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967090 2559 flags.go:64] FLAG: --lock-file="" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967094 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967099 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967103 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967110 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967114 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967119 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967123 2559 flags.go:64] FLAG: --logging-format="text" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967127 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967132 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967135 2559 flags.go:64] FLAG: --manifest-url="" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967140 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967146 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967150 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967160 2559 flags.go:64] FLAG: --max-pods="110" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967166 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967170 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967174 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967178 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967182 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967186 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967190 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967200 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967205 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967209 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:14:48.066869 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967213 2559 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967217 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967225 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967230 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967234 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967238 2559 flags.go:64] FLAG: --port="10250" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967242 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967247 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac72072e41bd9283" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967251 2559 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967255 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967259 2559 flags.go:64] FLAG: --register-node="true" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967263 2559 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967269 2559 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967273 2559 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967277 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967281 2559 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967286 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967290 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967294 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967299 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967303 2559 flags.go:64] FLAG: --runonce="false" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967307 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967313 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967317 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967321 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:14:48.067921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967325 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967329 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967332 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967337 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967341 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967345 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967349 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967353 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967357 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967361 2559 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967368 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967376 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967379 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967384 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967389 2559 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967393 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967397 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967400 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967404 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967408 2559 flags.go:64] FLAG: --v="2" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967414 2559 flags.go:64] FLAG: --version="false" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967420 2559 flags.go:64] FLAG: --vmodule="" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967425 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.967429 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967602 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:14:48.068550 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967607 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967611 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967617 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967621 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967627 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967631 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967634 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967638 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967642 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967646 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967650 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967654 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967657 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967661 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967665 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967669 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967673 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967677 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967681 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967685 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:14:48.069409 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967688 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967692 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967696 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967700 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967704 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967707 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967711 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967717 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967722 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967727 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967731 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967734 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967738 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967742 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967747 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967751 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967756 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967759 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967763 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:14:48.070367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967767 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967771 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967775 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967779 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967782 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967786 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967789 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967794 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967797 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967801 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967807 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967811 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967817 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967822 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967827 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967831 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967836 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967840 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967845 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:14:48.071076 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967848 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967852 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967856 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967860 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967865 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967870 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967875 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967880 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967884 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967888 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967894 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967897 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967901 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967904 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967908 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967912 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967916 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967919 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967923 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:14:48.071922 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967927 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967930 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967934 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967938 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967943 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967947 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967950 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967954 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967958 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967962 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967966 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967970 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967974 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967977 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967980 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967984 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967988 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967992 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.967999 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.968003 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:14:48.072833 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.968007 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.968014 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.974944 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.974959 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.974977 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.974982 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975034 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975039 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975042 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975045 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975048 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975051 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975054 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975056 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975059 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:14:48.073801 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975061 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975065 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975069 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975072 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975075 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975079 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975081 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975084 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975087 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975089 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975092 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975094 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975097 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975099 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975102 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975104 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975107 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975109 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975112 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975116 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:14:48.176029 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975120 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975122 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975125 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975128 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975130 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975133 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975135 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975138 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975140 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975143 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975146 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975148 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975151 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975154 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975156 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975159 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975161 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975165 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975169 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975172 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:14:48.176795 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975175 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975178 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975181 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975184 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975187 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975190 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975192 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975195 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975197 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975200 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975202 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975205 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975208 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975211 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975213 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975217 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975220 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975223 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975225 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:14:48.177869 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975229 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975232 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975234 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975237 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975239 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975242 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975245 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975248 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975250 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975253 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975255 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975258 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975260 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975263 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975265 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975268 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975271 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975274 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975276 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975279 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:14:48.178535 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975281 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975284 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975287 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975290 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975292 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975295 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975297 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975300 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975303 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975305 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975308 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.975313 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975418 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975422 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975425 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:14:48.179227 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975428 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975431 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975434 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975439 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975442 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975444 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975447 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975449 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975454 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975457 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975459 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975462 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975464 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975467 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975470 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975472 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975476 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975480 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975483 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:14:48.183335 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975486 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975489 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975492 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975495 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975498 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975501 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975504 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975507 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975509 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975513 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975516 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975518 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975521 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975523 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975526 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975528 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975533 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975535 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975538 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:14:48.184011 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975540 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975543 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975547 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975549 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975552 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975569 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975574 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975577 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975581 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975584 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975587 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975591 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975593 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975596 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975599 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975601 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975604 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975607 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975609 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:14:48.192893 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975612 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975615 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975618 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975620 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975623 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975626 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975629 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975631 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975634 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975636 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975640 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975643 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975645 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975648 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975651 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975654 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975657 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975659 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975662 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:14:48.215100 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975665 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975667 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975670 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975672 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975675 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975677 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975680 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975683 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975685 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975688 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975690 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975693 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975695 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975698 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975700 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975704 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975706 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975709 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975711 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:14:48.215665 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:47.975714 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.975719 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.975809 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.978183 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.979903 2559 server.go:1019] "Starting client certificate rotation" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.980005 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.980034 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.982416 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.985126 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:47.994268 2559 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.014549 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.016450 2559 log.go:25] "Validated CRI v1 image API" Jul 06 20:14:48.216230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.017150 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:14:48.216600 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.020355 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ccfa5366-0267-4946-8253-a4aa29b54d3c:/dev/nvme0n1p3 fe6b63dc-3257-4113-a031-01d076ae56da:/dev/nvme0n1p4] Jul 06 20:14:48.216600 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.020373 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.025010 2559 manager.go:216] Machine: {Timestamp:2026-07-06 20:14:48.023868462 +0000 UTC m=+0.356856312 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106996 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec255e139c649b9fdf055cc7d60a03c1 SystemUUID:ec255e13-9c64-9b9f-df05-5cc7d60a03c1 BootID:ae72a934-5a81-4903-b729-a19cb60e5819 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:c0:00:ba:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:c0:00:ba:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:ae:35:b2:9a:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.025106 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.025174 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.026978 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.026999 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.027923 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.027936 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.027944 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.028706 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.030823 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.034819 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.034962 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.034992 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.035003 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.035017 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.035026 2559 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.035034 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:14:48.216781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.035354 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.035368 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.038543 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.041063 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.041094 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042327 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042340 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042346 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042353 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042363 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042369 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042377 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042382 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042388 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042393 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042407 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.042412 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.043957 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.043968 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.047246 2559 server.go:1268] "Started kubelet" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.047328 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.047345 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.047401 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.048444 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.052821 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.054278 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.055622 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.059031 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.059115 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.058846 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18bfcc8e13874cd7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:ip-10-0-136-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-07-06 20:14:48.047062231 +0000 UTC m=+0.380050083,LastTimestamp:2026-07-06 20:14:48.047062231 +0000 UTC m=+0.380050083,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.069391 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.069411 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.069467 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070207 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070227 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070206 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070355 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070384 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070388 2559 factory.go:55] Registering systemd factory Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070404 2559 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070610 2559 factory.go:153] Registering CRI-O factory Jul 06 20:14:48.217373 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070623 2559 factory.go:223] Registration of the crio container factory successfully Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070675 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070698 2559 factory.go:103] Registering Raw factory Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.070713 2559 manager.go:1196] Started watching for new ooms in manager Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.071139 2559 manager.go:349] Starting recovery of all containers Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.071783 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.071974 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.081975 2559 manager.go:354] Recovery completed Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.085455 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.087186 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.087212 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.087223 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.087692 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.087703 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.087710 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.087721 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.088388 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.088409 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.088417 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.089204 2559 policy_none.go:49] "None policy: Start" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.089220 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.089231 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.089838 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18bfcc8e15ebc034 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:ip-10-0-136-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-07-06 20:14:48.087199796 +0000 UTC m=+0.420187645,LastTimestamp:2026-07-06 20:14:48.087199796 +0000 UTC m=+0.420187645,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.090529 2559 policy_none.go:47] "Start" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.105712 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18bfcc8e15ec03c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:ip-10-0-136-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-07-06 20:14:48.087217091 +0000 UTC m=+0.420204941,LastTimestamp:2026-07-06 20:14:48.087217091 +0000 UTC m=+0.420204941,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}" Jul 06 20:14:48.218507 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.107575 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18bfcc8e15ec2895 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:ip-10-0-136-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-07-06 20:14:48.087226517 +0000 UTC m=+0.420214366,LastTimestamp:2026-07-06 20:14:48.087226517 +0000 UTC m=+0.420214366,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.118758 2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-202.ec2.internal.18bfcc8e15ebc034\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18bfcc8e15ebc034 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:ip-10-0-136-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-07-06 20:14:48.087199796 +0000 UTC m=+0.420187645,LastTimestamp:2026-07-06 20:14:48.088397498 +0000 UTC m=+0.421385350,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.130280 2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-202.ec2.internal.18bfcc8e15ec03c3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18bfcc8e15ec03c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:ip-10-0-136-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-07-06 20:14:48.087217091 +0000 UTC m=+0.420204941,LastTimestamp:2026-07-06 20:14:48.088412886 +0000 UTC m=+0.421400736,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.137364 2559 manager.go:337] "Starting Device Plugin manager" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.137509 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.137521 2559 server.go:87] "Starting device plugin registration server" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.137755 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.137766 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.137896 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.137974 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.137983 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.138480 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.138523 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.138546 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5tsbf" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.138813 2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-202.ec2.internal.18bfcc8e15ec2895\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-202.ec2.internal.18bfcc8e15ec2895 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-202.ec2.internal,UID:ip-10-0-136-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-202.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-202.ec2.internal,},FirstTimestamp:2026-07-06 20:14:48.087226517 +0000 UTC m=+0.420214366,LastTimestamp:2026-07-06 20:14:48.088421328 +0000 UTC m=+0.421409177,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-202.ec2.internal,}" Jul 06 20:14:48.219291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.147402 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5tsbf" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.238735 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.239492 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.239520 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.239535 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.239580 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.247347 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.248484 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.248517 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.248534 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.248579 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.249147 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.249167 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-202.ec2.internal\": node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.250810 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.327379 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.349437 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal"] Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.349494 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.351097 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.351119 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.351128 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.352700 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.352835 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.352859 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.353416 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.353432 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.353442 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.353483 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.353507 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.353522 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.354751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.354780 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.355356 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.355379 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.355389 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.372273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/897d6bcf4199302dfb88bc40b83b5bcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"897d6bcf4199302dfb88bc40b83b5bcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.372293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/897d6bcf4199302dfb88bc40b83b5bcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"897d6bcf4199302dfb88bc40b83b5bcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.381488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.372310 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a35c3367aea0364e635c7dba529cb3ff-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"a35c3367aea0364e635c7dba529cb3ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.386800 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.384108 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-202.ec2.internal\" not found" node="ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.393553 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.390906 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-202.ec2.internal\" not found" node="ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.578892 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.427897 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.578892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.477101 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/897d6bcf4199302dfb88bc40b83b5bcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"897d6bcf4199302dfb88bc40b83b5bcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.578892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.477131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/897d6bcf4199302dfb88bc40b83b5bcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"897d6bcf4199302dfb88bc40b83b5bcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.578892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.477151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a35c3367aea0364e635c7dba529cb3ff-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"a35c3367aea0364e635c7dba529cb3ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.578892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.477186 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a35c3367aea0364e635c7dba529cb3ff-config\") pod \"kube-apiserver-proxy-ip-10-0-136-202.ec2.internal\" (UID: \"a35c3367aea0364e635c7dba529cb3ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.578892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.477212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/897d6bcf4199302dfb88bc40b83b5bcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"897d6bcf4199302dfb88bc40b83b5bcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.578892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.477224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/897d6bcf4199302dfb88bc40b83b5bcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal\" (UID: \"897d6bcf4199302dfb88bc40b83b5bcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.578892 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.528691 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.768805 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.629335 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.768805 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.688207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.768805 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.695601 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" Jul 06 20:14:48.768805 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.729396 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.933096 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.829581 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-202.ec2.internal\" not found" Jul 06 20:14:48.933096 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.885304 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.970741 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.978990 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.979086 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.979124 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:48.979156 2559 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a4c376c0a0b144bccb8b60521bb996ff-542fe4622e2eb115.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.136.202:46464->50.19.107.91:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:48.979178 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.005717 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.036131 2559 apiserver.go:52] "Watching apiserver" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.049308 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.051460 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-mrtnc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm","openshift-image-registry/node-ca-qpjz2","openshift-multus/multus-6jn6v","openshift-multus/multus-additional-cni-plugins-wrn2h","openshift-network-diagnostics/network-check-target-8lgdr","openshift-network-operator/iptables-alerter-wlkqd","openshift-ovn-kubernetes/ovnkube-node-2qdff","kube-system/global-pull-secret-syncer-t8dz6","kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal","openshift-cluster-node-tuning-operator/tuned-f5ztz","openshift-multus/network-metrics-daemon-4448z"] Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.053006 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.054166 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.055365 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.055864 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.055863 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zlqph\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.056256 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.056309 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.056696 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9p58p\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.056772 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.058172 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.063000 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.064379 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.064435 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.064459 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.064621 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.064689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.064771 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.064783 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.064834 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.064843 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:14:49.121318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.065084 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-58zgd\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.065241 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b5xbg\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.065260 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.065527 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.065603 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gqpc7\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.066032 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.066772 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.067173 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.068110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.068971 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.069038 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.069127 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t8qhr\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.069261 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.069476 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.069869 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.069932 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.071264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.072582 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.072644 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.072710 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.072724 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.072842 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.072898 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.072911 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.072978 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-82vcn\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.073058 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.077830 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.077913 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.077927 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zt57m\"" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-node-log\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovn-node-metrics-cert\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.123581 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-socket-dir-parent\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-multus-certs\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-modprobe-d\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080257 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-kubernetes\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-system-cni-dir\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-kubelet\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysconfig\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8rrj\" (UniqueName: \"kubernetes.io/projected/8e29849a-478b-472c-9c4f-bdc4a2eb8280-kube-api-access-r8rrj\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-systemd\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-tuned\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e4458c9-0214-4543-a480-3192c30f0e18-host\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d090ec73-b76e-4e0e-b7ae-860b9c17c792-iptables-alerter-script\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080509 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-var-lib-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.125187 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovnkube-script-lib\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-socket-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-device-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-sys-fs\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-cnibin\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-conf-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-etc-kubernetes\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysctl-d\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-host\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e3177b7-2789-4fe3-9c3c-26949144b765-kubelet-config\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-systemd-units\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080786 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-env-overrides\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-lib-modules\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.127407 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovnkube-config\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-registration-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-k8s-cni-cncf-io\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cnibin\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080945 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbljd\" (UniqueName: \"kubernetes.io/projected/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-kube-api-access-xbljd\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-cni-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcxjv\" (UniqueName: \"kubernetes.io/projected/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-kube-api-access-dcxjv\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.080992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-run\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-tmp\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysctl-conf\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-sys\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e4458c9-0214-4543-a480-3192c30f0e18-serviceca\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-slash\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-systemd\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-cni-binary-copy\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mssxt\" (UniqueName: \"kubernetes.io/projected/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-kube-api-access-mssxt\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.128299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40f05366-8faa-433c-a760-97c707e1d325-konnectivity-ca\") pod \"konnectivity-agent-mrtnc\" (UID: \"40f05366-8faa-433c-a760-97c707e1d325\") " pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-os-release\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d090ec73-b76e-4e0e-b7ae-860b9c17c792-host-slash\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-cni-bin\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-cni-bin\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-cni-multus\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-daemon-config\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081310 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-system-cni-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-netns\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-kubelet\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdkkn\" (UniqueName: \"kubernetes.io/projected/d090ec73-b76e-4e0e-b7ae-860b9c17c792-kube-api-access-wdkkn\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081411 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-run-netns\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.129847 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-ovn\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-var-lib-kubelet\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqtjw\" (UniqueName: \"kubernetes.io/projected/9e4458c9-0214-4543-a480-3192c30f0e18-kube-api-access-qqtjw\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e3177b7-2789-4fe3-9c3c-26949144b765-dbus\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-cni-netd\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2fs4\" (UniqueName: \"kubernetes.io/projected/424aaa02-561c-4ec7-bd22-62ec14eb4678-kube-api-access-r2fs4\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40f05366-8faa-433c-a760-97c707e1d325-agent-certs\") pod \"konnectivity-agent-mrtnc\" (UID: \"40f05366-8faa-433c-a760-97c707e1d325\") " pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-etc-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-os-release\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-log-socket\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.081668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-hostroot\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.094019 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:14:49.130958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.113582 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6pzrr" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.142034 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6pzrr" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.150974 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:09:48 +0000 UTC" deadline="2028-01-03 10:34:15.214718497 +0000 UTC" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.150991 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13094h19m26.063729942s" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.170484 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.181938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-node-log\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.181965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovn-node-metrics-cert\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.181990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182012 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-socket-dir-parent\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182034 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-multus-certs\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182055 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-modprobe-d\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182058 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-node-log\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-kubernetes\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-system-cni-dir\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182113 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-kubelet\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.182117 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysconfig\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-multus-certs\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-kubernetes\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-socket-dir-parent\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.277779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-kubelet\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysconfig\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.182217 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret podName:9e3177b7-2789-4fe3-9c3c-26949144b765 nodeName:}" failed. No retries permitted until 2026-07-06 20:14:49.682173664 +0000 UTC m=+2.015161501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret") pod "global-pull-secret-syncer-t8dz6" (UID: "9e3177b7-2789-4fe3-9c3c-26949144b765") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182269 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182311 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182343 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8rrj\" (UniqueName: \"kubernetes.io/projected/8e29849a-478b-472c-9c4f-bdc4a2eb8280-kube-api-access-r8rrj\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-systemd\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-tuned\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e4458c9-0214-4543-a480-3192c30f0e18-host\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182418 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182468 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d090ec73-b76e-4e0e-b7ae-860b9c17c792-iptables-alerter-script\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-systemd\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-var-lib-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovnkube-script-lib\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-socket-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e4458c9-0214-4543-a480-3192c30f0e18-host\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.279233 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-device-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-sys-fs\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-cnibin\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-system-cni-dir\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-conf-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-device-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182794 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-etc-kubernetes\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysctl-d\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-host\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e3177b7-2789-4fe3-9c3c-26949144b765-kubelet-config\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-systemd-units\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-env-overrides\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-lib-modules\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.280143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovnkube-config\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-registration-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-k8s-cni-cncf-io\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183087 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-registration-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cnibin\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-socket-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-var-lib-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.182166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-modprobe-d\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183160 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-k8s-cni-cncf-io\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-sys-fs\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e3177b7-2789-4fe3-9c3c-26949144b765-kubelet-config\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183226 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-systemd-units\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183262 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-cnibin\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-conf-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183311 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysctl-d\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.281280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-lib-modules\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-host\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-etc-kubernetes\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183459 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovnkube-script-lib\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183621 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-env-overrides\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183735 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cnibin\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovnkube-config\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbljd\" (UniqueName: \"kubernetes.io/projected/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-kube-api-access-xbljd\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-cni-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcxjv\" (UniqueName: \"kubernetes.io/projected/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-kube-api-access-dcxjv\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-run\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-tmp\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.183898 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e29849a-478b-472c-9c4f-bdc4a2eb8280-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184012 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d090ec73-b76e-4e0e-b7ae-860b9c17c792-iptables-alerter-script\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184020 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysctl-conf\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-sys\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-run\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.283069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184044 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-cni-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e4458c9-0214-4543-a480-3192c30f0e18-serviceca\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184125 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-sys\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-slash\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184157 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-systemd\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-slash\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-sysctl-conf\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-cni-binary-copy\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mssxt\" (UniqueName: \"kubernetes.io/projected/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-kube-api-access-mssxt\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-systemd\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40f05366-8faa-433c-a760-97c707e1d325-konnectivity-ca\") pod \"konnectivity-agent-mrtnc\" (UID: \"40f05366-8faa-433c-a760-97c707e1d325\") " pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-os-release\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d090ec73-b76e-4e0e-b7ae-860b9c17c792-host-slash\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-cni-bin\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-cni-bin\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.284238 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-cni-multus\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-daemon-config\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184490 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e4458c9-0214-4543-a480-3192c30f0e18-serviceca\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-os-release\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-system-cni-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184583 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-cni-multus\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184542 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d090ec73-b76e-4e0e-b7ae-860b9c17c792-host-slash\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-netns\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184647 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-cni-bin\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-kubelet\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184669 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184578 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-cni-bin\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.285181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gtk\" (UniqueName: \"kubernetes.io/projected/85d46691-3809-443c-8a0c-b955a8de3992-kube-api-access-t6gtk\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184761 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-cni-binary-copy\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdkkn\" (UniqueName: \"kubernetes.io/projected/d090ec73-b76e-4e0e-b7ae-860b9c17c792-kube-api-access-wdkkn\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-run-netns\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-run-netns\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40f05366-8faa-433c-a760-97c707e1d325-konnectivity-ca\") pod \"konnectivity-agent-mrtnc\" (UID: \"40f05366-8faa-433c-a760-97c707e1d325\") " pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-host-var-lib-kubelet\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184850 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-system-cni-dir\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-ovn\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184979 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-run-ovn\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185001 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-run-netns\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185081 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-var-lib-kubelet\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185229 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-multus-daemon-config\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.184911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-var-lib-kubelet\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqtjw\" (UniqueName: \"kubernetes.io/projected/9e4458c9-0214-4543-a480-3192c30f0e18-kube-api-access-qqtjw\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e3177b7-2789-4fe3-9c3c-26949144b765-dbus\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-cni-netd\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.286097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2fs4\" (UniqueName: \"kubernetes.io/projected/424aaa02-561c-4ec7-bd22-62ec14eb4678-kube-api-access-r2fs4\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40f05366-8faa-433c-a760-97c707e1d325-agent-certs\") pod \"konnectivity-agent-mrtnc\" (UID: \"40f05366-8faa-433c-a760-97c707e1d325\") " pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185527 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-host-cni-netd\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-etc-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e29849a-478b-472c-9c4f-bdc4a2eb8280-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e3177b7-2789-4fe3-9c3c-26949144b765-dbus\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.185957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-os-release\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.186009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-log-socket\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.186040 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-os-release\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.186060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-log-socket\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.186101 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/424aaa02-561c-4ec7-bd22-62ec14eb4678-etc-openvswitch\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.186206 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-hostroot\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.186344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-etc-tuned\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.186408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-tmp\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.186465 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/424aaa02-561c-4ec7-bd22-62ec14eb4678-ovn-node-metrics-cert\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.188759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-hostroot\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.191547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40f05366-8faa-433c-a760-97c707e1d325-agent-certs\") pod \"konnectivity-agent-mrtnc\" (UID: \"40f05366-8faa-433c-a760-97c707e1d325\") " pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.192328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8rrj\" (UniqueName: \"kubernetes.io/projected/8e29849a-478b-472c-9c4f-bdc4a2eb8280-kube-api-access-r8rrj\") pod \"multus-additional-cni-plugins-wrn2h\" (UID: \"8e29849a-478b-472c-9c4f-bdc4a2eb8280\") " pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.193632 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:14:49.287486 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.193656 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.193666 2559 projected.go:196] Error preparing data for projected volume kube-api-access-zxhkm for pod openshift-network-diagnostics/network-check-target-8lgdr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.193716 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm podName:b80e5002-f2ac-425b-9c81-73eaf072ea4d nodeName:}" failed. No retries permitted until 2026-07-06 20:14:49.693702162 +0000 UTC m=+2.026690020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhkm" (UniqueName: "kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm") pod "network-check-target-8lgdr" (UID: "b80e5002-f2ac-425b-9c81-73eaf072ea4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.197734 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcxjv\" (UniqueName: \"kubernetes.io/projected/f2e416e4-d89b-423e-b6dc-b7f577cb7d11-kube-api-access-dcxjv\") pod \"multus-6jn6v\" (UID: \"f2e416e4-d89b-423e-b6dc-b7f577cb7d11\") " pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.198786 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.203146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbljd\" (UniqueName: \"kubernetes.io/projected/11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2-kube-api-access-xbljd\") pod \"aws-ebs-csi-driver-node-hrbbm\" (UID: \"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.203372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mssxt\" (UniqueName: \"kubernetes.io/projected/ba627fc2-54aa-4b67-b8f0-5b621e0d15f4-kube-api-access-mssxt\") pod \"tuned-f5ztz\" (UID: \"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4\") " pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.203585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2fs4\" (UniqueName: \"kubernetes.io/projected/424aaa02-561c-4ec7-bd22-62ec14eb4678-kube-api-access-r2fs4\") pod \"ovnkube-node-2qdff\" (UID: \"424aaa02-561c-4ec7-bd22-62ec14eb4678\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.204036 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdkkn\" (UniqueName: \"kubernetes.io/projected/d090ec73-b76e-4e0e-b7ae-860b9c17c792-kube-api-access-wdkkn\") pod \"iptables-alerter-wlkqd\" (UID: \"d090ec73-b76e-4e0e-b7ae-860b9c17c792\") " pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.204140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqtjw\" (UniqueName: \"kubernetes.io/projected/9e4458c9-0214-4543-a480-3192c30f0e18-kube-api-access-qqtjw\") pod \"node-ca-qpjz2\" (UID: \"9e4458c9-0214-4543-a480-3192c30f0e18\") " pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.219169 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wlkqd" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.233188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.238442 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.287783 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.287811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gtk\" (UniqueName: \"kubernetes.io/projected/85d46691-3809-443c-8a0c-b955a8de3992-kube-api-access-t6gtk\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.288032 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:49.288620 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.288100 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs podName:85d46691-3809-443c-8a0c-b955a8de3992 nodeName:}" failed. No retries permitted until 2026-07-06 20:14:49.788081309 +0000 UTC m=+2.121069161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs") pod "network-metrics-daemon-4448z" (UID: "85d46691-3809-443c-8a0c-b955a8de3992") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:49.407398 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.302828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gtk\" (UniqueName: \"kubernetes.io/projected/85d46691-3809-443c-8a0c-b955a8de3992-kube-api-access-t6gtk\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:49.407398 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.341775 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:14:49.407398 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.367975 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897d6bcf4199302dfb88bc40b83b5bcb.slice/crio-424bbdf6c30c94fed65b3744b8260e8707452470f0f14c7030a4bf7ab9494fee WatchSource:0}: Error finding container 424bbdf6c30c94fed65b3744b8260e8707452470f0f14c7030a4bf7ab9494fee: Status 404 returned error can't find the container with id 424bbdf6c30c94fed65b3744b8260e8707452470f0f14c7030a4bf7ab9494fee Jul 06 20:14:49.407398 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.368517 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35c3367aea0364e635c7dba529cb3ff.slice/crio-ff441742229b1b7ccb2c66af5897859f172c30c42d471d135489533e2a6670d9 WatchSource:0}: Error finding container ff441742229b1b7ccb2c66af5897859f172c30c42d471d135489533e2a6670d9: Status 404 returned error can't find the container with id ff441742229b1b7ccb2c66af5897859f172c30c42d471d135489533e2a6670d9 Jul 06 20:14:49.407398 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.375604 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:14:49.407398 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.397176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:14:49.407398 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.404386 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f05366_8faa_433c_a760_97c707e1d325.slice/crio-cf47b0e4b3c951fecacc1a4c62fe326294d72244ac0876afd993374c0cb2f3d5 WatchSource:0}: Error finding container cf47b0e4b3c951fecacc1a4c62fe326294d72244ac0876afd993374c0cb2f3d5: Status 404 returned error can't find the container with id cf47b0e4b3c951fecacc1a4c62fe326294d72244ac0876afd993374c0cb2f3d5 Jul 06 20:14:49.411821 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.411412 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" Jul 06 20:14:49.628131 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.417920 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e6c5dc_6048_47c3_8d25_6d26d0c2e1e2.slice/crio-3add03560cec94518f82aeeb60a478c1718059e562191f3389d8a951ea327044 WatchSource:0}: Error finding container 3add03560cec94518f82aeeb60a478c1718059e562191f3389d8a951ea327044: Status 404 returned error can't find the container with id 3add03560cec94518f82aeeb60a478c1718059e562191f3389d8a951ea327044 Jul 06 20:14:49.628131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.456256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qpjz2" Jul 06 20:14:49.628131 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.462823 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4458c9_0214_4543_a480_3192c30f0e18.slice/crio-c8d405773655efc72141ae39a466727fab8f4e72fc7fc237c9694e97487013ca WatchSource:0}: Error finding container c8d405773655efc72141ae39a466727fab8f4e72fc7fc237c9694e97487013ca: Status 404 returned error can't find the container with id c8d405773655efc72141ae39a466727fab8f4e72fc7fc237c9694e97487013ca Jul 06 20:14:49.628131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.478428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6jn6v" Jul 06 20:14:49.628131 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.485371 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e416e4_d89b_423e_b6dc_b7f577cb7d11.slice/crio-0d121183ab602a7f40ba33ee3c1bda672a5b16101c79115c97b4f1fb64e2602f WatchSource:0}: Error finding container 0d121183ab602a7f40ba33ee3c1bda672a5b16101c79115c97b4f1fb64e2602f: Status 404 returned error can't find the container with id 0d121183ab602a7f40ba33ee3c1bda672a5b16101c79115c97b4f1fb64e2602f Jul 06 20:14:49.628131 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.515309 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e29849a_478b_472c_9c4f_bdc4a2eb8280.slice/crio-6811b95c70769a59f6681a58aff817f24708c1968c2098625bf7f4d0396df62b WatchSource:0}: Error finding container 6811b95c70769a59f6681a58aff817f24708c1968c2098625bf7f4d0396df62b: Status 404 returned error can't find the container with id 6811b95c70769a59f6681a58aff817f24708c1968c2098625bf7f4d0396df62b Jul 06 20:14:49.628131 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.571301 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd090ec73_b76e_4e0e_b7ae_860b9c17c792.slice/crio-97a24ce4d2999c330c0969ca89b9ccda0565b007d8e69d44f3bc1c3b36fd392f WatchSource:0}: Error finding container 97a24ce4d2999c330c0969ca89b9ccda0565b007d8e69d44f3bc1c3b36fd392f: Status 404 returned error can't find the container with id 97a24ce4d2999c330c0969ca89b9ccda0565b007d8e69d44f3bc1c3b36fd392f Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.660819 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424aaa02_561c_4ec7_bd22_62ec14eb4678.slice/crio-fb332f152aa01f284692aa23c889758bf25746b3d245019f456c7ab7330e6a74 WatchSource:0}: Error finding container fb332f152aa01f284692aa23c889758bf25746b3d245019f456c7ab7330e6a74: Status 404 returned error can't find the container with id fb332f152aa01f284692aa23c889758bf25746b3d245019f456c7ab7330e6a74 Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.690803 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.690883 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.690918 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret podName:9e3177b7-2789-4fe3-9c3c-26949144b765 nodeName:}" failed. No retries permitted until 2026-07-06 20:14:50.690907443 +0000 UTC m=+3.023895279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret") pod "global-pull-secret-syncer-t8dz6" (UID: "9e3177b7-2789-4fe3-9c3c-26949144b765") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:14:49.758423 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba627fc2_54aa_4b67_b8f0_5b621e0d15f4.slice/crio-ae20e42553827b68bc121d02bddb4ae07dba01c734bcc876ea8d97c3ffa26d3f WatchSource:0}: Error finding container ae20e42553827b68bc121d02bddb4ae07dba01c734bcc876ea8d97c3ffa26d3f: Status 404 returned error can't find the container with id ae20e42553827b68bc121d02bddb4ae07dba01c734bcc876ea8d97c3ffa26d3f Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.791630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:49.791672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.791756 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.791760 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.791779 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.791792 2559 projected.go:196] Error preparing data for projected volume kube-api-access-zxhkm for pod openshift-network-diagnostics/network-check-target-8lgdr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.791797 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs podName:85d46691-3809-443c-8a0c-b955a8de3992 nodeName:}" failed. No retries permitted until 2026-07-06 20:14:50.791785002 +0000 UTC m=+3.124772838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs") pod "network-metrics-daemon-4448z" (UID: "85d46691-3809-443c-8a0c-b955a8de3992") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:49.798300 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:49.791840 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm podName:b80e5002-f2ac-425b-9c81-73eaf072ea4d nodeName:}" failed. No retries permitted until 2026-07-06 20:14:50.791824416 +0000 UTC m=+3.124812253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhkm" (UniqueName: "kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm") pod "network-check-target-8lgdr" (UID: "b80e5002-f2ac-425b-9c81-73eaf072ea4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:50.077404 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.077234 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:14:50.144871 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.144747 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:09:49 +0000 UTC" deadline="2028-01-05 17:40:56.924335875 +0000 UTC" Jul 06 20:14:50.144871 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.144804 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13149h26m6.779535446s" Jul 06 20:14:50.249717 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.249673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:50.249855 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.249809 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:14:50.262388 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.262295 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" event={"ID":"a35c3367aea0364e635c7dba529cb3ff","Type":"ContainerStarted","Data":"ff441742229b1b7ccb2c66af5897859f172c30c42d471d135489533e2a6670d9"} Jul 06 20:14:50.286951 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.286920 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" event={"ID":"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4","Type":"ContainerStarted","Data":"ae20e42553827b68bc121d02bddb4ae07dba01c734bcc876ea8d97c3ffa26d3f"} Jul 06 20:14:50.304047 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.304013 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"fb332f152aa01f284692aa23c889758bf25746b3d245019f456c7ab7330e6a74"} Jul 06 20:14:50.311837 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.311777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6jn6v" event={"ID":"f2e416e4-d89b-423e-b6dc-b7f577cb7d11","Type":"ContainerStarted","Data":"0d121183ab602a7f40ba33ee3c1bda672a5b16101c79115c97b4f1fb64e2602f"} Jul 06 20:14:50.319302 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.319276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qpjz2" event={"ID":"9e4458c9-0214-4543-a480-3192c30f0e18","Type":"ContainerStarted","Data":"c8d405773655efc72141ae39a466727fab8f4e72fc7fc237c9694e97487013ca"} Jul 06 20:14:50.331383 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.331214 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" event={"ID":"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2","Type":"ContainerStarted","Data":"3add03560cec94518f82aeeb60a478c1718059e562191f3389d8a951ea327044"} Jul 06 20:14:50.349685 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.349614 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wlkqd" event={"ID":"d090ec73-b76e-4e0e-b7ae-860b9c17c792","Type":"ContainerStarted","Data":"97a24ce4d2999c330c0969ca89b9ccda0565b007d8e69d44f3bc1c3b36fd392f"} Jul 06 20:14:50.351499 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.351460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerStarted","Data":"6811b95c70769a59f6681a58aff817f24708c1968c2098625bf7f4d0396df62b"} Jul 06 20:14:50.359546 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.359505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mrtnc" event={"ID":"40f05366-8faa-433c-a760-97c707e1d325","Type":"ContainerStarted","Data":"cf47b0e4b3c951fecacc1a4c62fe326294d72244ac0876afd993374c0cb2f3d5"} Jul 06 20:14:50.387604 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.387579 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"897d6bcf4199302dfb88bc40b83b5bcb","Type":"ContainerStarted","Data":"424bbdf6c30c94fed65b3744b8260e8707452470f0f14c7030a4bf7ab9494fee"} Jul 06 20:14:50.698502 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.698470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:50.698685 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.698619 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:50.698762 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.698693 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret podName:9e3177b7-2789-4fe3-9c3c-26949144b765 nodeName:}" failed. No retries permitted until 2026-07-06 20:14:52.698666453 +0000 UTC m=+5.031654290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret") pod "global-pull-secret-syncer-t8dz6" (UID: "9e3177b7-2789-4fe3-9c3c-26949144b765") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:50.799583 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.798772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:50.799583 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:50.798819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:50.799583 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.798977 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:50.799583 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.799038 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs podName:85d46691-3809-443c-8a0c-b955a8de3992 nodeName:}" failed. No retries permitted until 2026-07-06 20:14:52.799017948 +0000 UTC m=+5.132005787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs") pod "network-metrics-daemon-4448z" (UID: "85d46691-3809-443c-8a0c-b955a8de3992") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:50.800108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.800073 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:14:50.800108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.800099 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:14:50.800108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.800113 2559 projected.go:196] Error preparing data for projected volume kube-api-access-zxhkm for pod openshift-network-diagnostics/network-check-target-8lgdr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:50.800319 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:50.800166 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm podName:b80e5002-f2ac-425b-9c81-73eaf072ea4d nodeName:}" failed. No retries permitted until 2026-07-06 20:14:52.800149285 +0000 UTC m=+5.133137123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhkm" (UniqueName: "kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm") pod "network-check-target-8lgdr" (UID: "b80e5002-f2ac-425b-9c81-73eaf072ea4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:51.068611 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:51.068354 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:14:51.145139 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:51.145099 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:09:49 +0000 UTC" deadline="2028-02-14 18:40:35.290353291 +0000 UTC" Jul 06 20:14:51.145139 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:51.145138 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14110h25m44.14521981s" Jul 06 20:14:51.250389 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:51.249736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:51.250389 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:51.249868 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:14:51.250389 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:51.250245 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:51.250389 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:51.250338 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:14:52.249201 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:52.248722 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:52.249201 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.248854 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:14:52.712956 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:52.712929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:52.713110 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.713046 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:52.713110 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.713098 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret podName:9e3177b7-2789-4fe3-9c3c-26949144b765 nodeName:}" failed. No retries permitted until 2026-07-06 20:14:56.713086002 +0000 UTC m=+9.046073838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret") pod "global-pull-secret-syncer-t8dz6" (UID: "9e3177b7-2789-4fe3-9c3c-26949144b765") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:52.814108 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:52.813464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:52.814108 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:52.813509 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:52.814108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.813644 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:52.814108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.813702 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs podName:85d46691-3809-443c-8a0c-b955a8de3992 nodeName:}" failed. No retries permitted until 2026-07-06 20:14:56.813684671 +0000 UTC m=+9.146672509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs") pod "network-metrics-daemon-4448z" (UID: "85d46691-3809-443c-8a0c-b955a8de3992") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:52.814108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.813788 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:14:52.814108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.813814 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:14:52.814108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.813824 2559 projected.go:196] Error preparing data for projected volume kube-api-access-zxhkm for pod openshift-network-diagnostics/network-check-target-8lgdr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:52.814108 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:52.813866 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm podName:b80e5002-f2ac-425b-9c81-73eaf072ea4d nodeName:}" failed. No retries permitted until 2026-07-06 20:14:56.813856214 +0000 UTC m=+9.146844049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhkm" (UniqueName: "kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm") pod "network-check-target-8lgdr" (UID: "b80e5002-f2ac-425b-9c81-73eaf072ea4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:53.248931 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:53.248902 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:53.249102 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:53.249054 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:14:53.249589 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:53.249432 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:53.249589 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:53.249524 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:14:54.251896 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:54.251371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:54.251896 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:54.251491 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:14:55.249364 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:55.249331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:55.249364 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:55.249331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:55.249621 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:55.249455 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:14:55.249621 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:55.249571 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:14:56.250153 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:56.250115 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:56.250616 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.250255 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:14:56.749097 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:56.749059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:56.749284 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.749237 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:56.749370 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.749304 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret podName:9e3177b7-2789-4fe3-9c3c-26949144b765 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:04.749288401 +0000 UTC m=+17.082276254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret") pod "global-pull-secret-syncer-t8dz6" (UID: "9e3177b7-2789-4fe3-9c3c-26949144b765") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:14:56.850389 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:56.850350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:56.850594 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.850516 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:14:56.850594 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.850543 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:14:56.850594 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.850571 2559 projected.go:196] Error preparing data for projected volume kube-api-access-zxhkm for pod openshift-network-diagnostics/network-check-target-8lgdr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:56.850780 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.850606 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:56.850780 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.850631 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm podName:b80e5002-f2ac-425b-9c81-73eaf072ea4d nodeName:}" failed. No retries permitted until 2026-07-06 20:15:04.850612919 +0000 UTC m=+17.183600776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhkm" (UniqueName: "kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm") pod "network-check-target-8lgdr" (UID: "b80e5002-f2ac-425b-9c81-73eaf072ea4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:14:56.850780 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:56.850650 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs podName:85d46691-3809-443c-8a0c-b955a8de3992 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:04.850640128 +0000 UTC m=+17.183627974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs") pod "network-metrics-daemon-4448z" (UID: "85d46691-3809-443c-8a0c-b955a8de3992") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:14:56.850780 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:56.850520 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:57.249791 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:57.249753 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:57.249990 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:57.249763 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:57.249990 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:57.249875 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:14:57.249990 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:57.249968 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:14:58.253321 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.252890 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:14:58.253321 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:58.253003 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:14:58.404206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.404171 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-rkg85"] Jul 06 20:14:58.407131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.407105 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.410391 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.410370 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:14:58.410620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.410604 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rq42z\"" Jul 06 20:14:58.411802 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.411782 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:14:58.464656 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.464630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e7b2cad-a984-4426-b072-a2eecc88de95-hosts-file\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.464779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.464675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfb9l\" (UniqueName: \"kubernetes.io/projected/9e7b2cad-a984-4426-b072-a2eecc88de95-kube-api-access-dfb9l\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.464779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.464735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7b2cad-a984-4426-b072-a2eecc88de95-tmp-dir\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.565246 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.565174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e7b2cad-a984-4426-b072-a2eecc88de95-hosts-file\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.565246 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.565209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfb9l\" (UniqueName: \"kubernetes.io/projected/9e7b2cad-a984-4426-b072-a2eecc88de95-kube-api-access-dfb9l\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.565246 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.565264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7b2cad-a984-4426-b072-a2eecc88de95-tmp-dir\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.565246 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.565359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e7b2cad-a984-4426-b072-a2eecc88de95-hosts-file\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.566240 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.566221 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7b2cad-a984-4426-b072-a2eecc88de95-tmp-dir\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.578002 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.577976 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfb9l\" (UniqueName: \"kubernetes.io/projected/9e7b2cad-a984-4426-b072-a2eecc88de95-kube-api-access-dfb9l\") pod \"node-resolver-rkg85\" (UID: \"9e7b2cad-a984-4426-b072-a2eecc88de95\") " pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:58.718153 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:58.718121 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rkg85" Jul 06 20:14:59.248930 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:59.248896 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:14:59.249107 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:14:59.248899 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:14:59.249107 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:59.249046 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:14:59.249219 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:14:59.249126 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:00.249599 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:00.249554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:00.250027 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:00.249698 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:01.249259 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:01.249228 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:01.249435 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:01.249358 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:01.249435 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:01.249397 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:01.249540 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:01.249465 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:02.249101 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:02.249061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:02.249624 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:02.249587 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:03.249593 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:03.249551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:03.250033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:03.249551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:03.250033 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:03.249694 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:03.250033 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:03.249745 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:04.249683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:04.249650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:04.250052 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.249773 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:04.804839 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:04.804765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:04.804976 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.804888 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:15:04.804976 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.804944 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret podName:9e3177b7-2789-4fe3-9c3c-26949144b765 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:20.804928981 +0000 UTC m=+33.137916830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret") pod "global-pull-secret-syncer-t8dz6" (UID: "9e3177b7-2789-4fe3-9c3c-26949144b765") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:15:04.905479 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:04.905435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:04.905479 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:04.905482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:04.905725 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.905591 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:15:04.905725 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.905619 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:15:04.905725 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.905625 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:15:04.905725 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.905631 2559 projected.go:196] Error preparing data for projected volume kube-api-access-zxhkm for pod openshift-network-diagnostics/network-check-target-8lgdr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:15:04.905725 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.905682 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs podName:85d46691-3809-443c-8a0c-b955a8de3992 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:20.905667159 +0000 UTC m=+33.238654999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs") pod "network-metrics-daemon-4448z" (UID: "85d46691-3809-443c-8a0c-b955a8de3992") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:15:04.905725 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:04.905697 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm podName:b80e5002-f2ac-425b-9c81-73eaf072ea4d nodeName:}" failed. No retries permitted until 2026-07-06 20:15:20.905691582 +0000 UTC m=+33.238679422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhkm" (UniqueName: "kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm") pod "network-check-target-8lgdr" (UID: "b80e5002-f2ac-425b-9c81-73eaf072ea4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:15:05.249234 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:05.249025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:05.249414 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:05.249083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:05.249414 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:05.249331 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:05.249414 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:05.249367 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:06.249052 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:06.249020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:06.249546 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:06.249149 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:07.249485 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:07.249452 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:07.249905 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:07.249592 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:07.249905 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:07.249625 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:07.249905 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:07.249691 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:08.249344 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:08.249312 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:08.249526 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:08.249408 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:08.954212 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:08.954186 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7b2cad_a984_4426_b072_a2eecc88de95.slice/crio-a405a84dd54293f0c48be523b07775a1d8fbec1957b31ce5f98506cd8b6ef253 WatchSource:0}: Error finding container a405a84dd54293f0c48be523b07775a1d8fbec1957b31ce5f98506cd8b6ef253: Status 404 returned error can't find the container with id a405a84dd54293f0c48be523b07775a1d8fbec1957b31ce5f98506cd8b6ef253 Jul 06 20:15:09.248938 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.248915 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:09.249087 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.248955 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:09.249087 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:09.249068 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:09.249198 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:09.249179 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:09.433012 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.432974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" event={"ID":"a35c3367aea0364e635c7dba529cb3ff","Type":"ContainerStarted","Data":"4ea104db25d7e9cf31c0f5dcbbfd1953f294bdf850d8bb82a5b906aa7c838603"} Jul 06 20:15:09.437183 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.437148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rkg85" event={"ID":"9e7b2cad-a984-4426-b072-a2eecc88de95","Type":"ContainerStarted","Data":"a405a84dd54293f0c48be523b07775a1d8fbec1957b31ce5f98506cd8b6ef253"} Jul 06 20:15:09.440464 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.440439 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" event={"ID":"ba627fc2-54aa-4b67-b8f0-5b621e0d15f4","Type":"ContainerStarted","Data":"ccff6e5f40431f35db664f5d9168a94c4f87614b68b7a5065877f49c2ad32445"} Jul 06 20:15:09.443201 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.443181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"3f781fca2f8162380c373d64897f71435ee0f1dc2827e4ee7d9c3cb1bafa0b57"} Jul 06 20:15:09.447029 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.446974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6jn6v" event={"ID":"f2e416e4-d89b-423e-b6dc-b7f577cb7d11","Type":"ContainerStarted","Data":"2d4d1d730c3ba01c576d08e8986288c823c88f193ecabdfdca83cccd3be5427b"} Jul 06 20:15:09.451675 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.451589 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-202.ec2.internal" podStartSLOduration=20.451539629 podStartE2EDuration="20.451539629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:09.450165687 +0000 UTC m=+21.783153570" watchObservedRunningTime="2026-07-06 20:15:09.451539629 +0000 UTC m=+21.784527488" Jul 06 20:15:09.491133 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.490976 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f5ztz" podStartSLOduration=2.29635447 podStartE2EDuration="21.490961239s" totalImagesPullingTime="19.194606769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:09.470802484 +0000 UTC m=+21.803790343" watchObservedRunningTime="2026-07-06 20:15:09.490961239 +0000 UTC m=+21.823949094" Jul 06 20:15:09.491393 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:09.491351 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6jn6v" podStartSLOduration=1.9943437560000001 podStartE2EDuration="21.491344218s" totalImagesPullingTime="19.497000462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:09.490767502 +0000 UTC m=+21.823755360" watchObservedRunningTime="2026-07-06 20:15:09.491344218 +0000 UTC m=+21.824332077" Jul 06 20:15:10.249445 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.249228 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:10.249698 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:10.249550 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:10.450127 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.450091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qpjz2" event={"ID":"9e4458c9-0214-4543-a480-3192c30f0e18","Type":"ContainerStarted","Data":"b3e72cca0718102931e24dc8ce878aca4a4b6d40e50157912f794a89dc01d692"} Jul 06 20:15:10.451635 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.451612 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" event={"ID":"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2","Type":"ContainerStarted","Data":"c39d07ef748cfed03ea3c5f27825fb8438b20a8f57f480c80a275fd3bc47540b"} Jul 06 20:15:10.452924 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.452904 2559 generic.go:356] "Generic (PLEG): container finished" podID="8e29849a-478b-472c-9c4f-bdc4a2eb8280" containerID="a7b2a5332a98f6e254196278652b5e8b61e0f88c185e82f1cc2e8bf3607aaa76" exitCode=0 Jul 06 20:15:10.453019 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.452970 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerDied","Data":"a7b2a5332a98f6e254196278652b5e8b61e0f88c185e82f1cc2e8bf3607aaa76"} Jul 06 20:15:10.454390 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.454317 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mrtnc" event={"ID":"40f05366-8faa-433c-a760-97c707e1d325","Type":"ContainerStarted","Data":"0f6d1fb0c2779db2e6528aaf0fb862c2698af77cd20462f51499ded3bdb9ab36"} Jul 06 20:15:10.455811 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.455778 2559 generic.go:356] "Generic (PLEG): container finished" podID="897d6bcf4199302dfb88bc40b83b5bcb" containerID="e9e9d5a6b8bba11870a72ea29159c50b3819ce8976c61f1a553169750e235f64" exitCode=0 Jul 06 20:15:10.455898 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.455858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"897d6bcf4199302dfb88bc40b83b5bcb","Type":"ContainerDied","Data":"e9e9d5a6b8bba11870a72ea29159c50b3819ce8976c61f1a553169750e235f64"} Jul 06 20:15:10.455958 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.455946 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" Jul 06 20:15:10.457276 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.457257 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rkg85" event={"ID":"9e7b2cad-a984-4426-b072-a2eecc88de95","Type":"ContainerStarted","Data":"d80dec4f35fbbc39a9eb011f29b90294ff5c6ffbe990453b42a678d1388f1363"} Jul 06 20:15:10.460104 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.460086 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"f8c5466a7b897b3908476663350b1a21888bbb75559075cacbf139208e596eb7"} Jul 06 20:15:10.460206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.460138 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"5f014dc51ad2d3330492ce63cd766c1db51034fb5140b54ceb0c2f559d79eded"} Jul 06 20:15:10.460206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.460167 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"fd6b757279f8c03ad5610c85c4ed16f6c4a5b81ea5bc0f9b983c810284d1da26"} Jul 06 20:15:10.460206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.460195 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"2c7b70f0d74ddcd65e401023cc44bb41695a8852034286d783fab871f1e19ce1"} Jul 06 20:15:10.460312 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.460226 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"ea47943c283a8213681e04902a611a73832ce462c39e0a575f06018eb12b0966"} Jul 06 20:15:10.483190 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.483163 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:15:10.483842 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.483803 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qpjz2" podStartSLOduration=2.99678766 podStartE2EDuration="22.483785608s" totalImagesPullingTime="19.486997948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:10.475168985 +0000 UTC m=+22.808156864" watchObservedRunningTime="2026-07-06 20:15:10.483785608 +0000 UTC m=+22.816773466" Jul 06 20:15:10.484476 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.484458 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal"] Jul 06 20:15:10.532415 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.532353 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rkg85" podStartSLOduration=12.532338729 podStartE2EDuration="12.532338729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:10.531989484 +0000 UTC m=+22.864977342" watchObservedRunningTime="2026-07-06 20:15:10.532338729 +0000 UTC m=+22.865326588" Jul 06 20:15:10.560056 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:10.560010 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mrtnc" podStartSLOduration=3.0380515 podStartE2EDuration="22.559992985s" totalImagesPullingTime="19.521941485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:10.559693848 +0000 UTC m=+22.892681717" watchObservedRunningTime="2026-07-06 20:15:10.559992985 +0000 UTC m=+22.892980821" Jul 06 20:15:11.249689 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:11.249664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:11.249836 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:11.249780 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:11.249836 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:11.249822 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:11.249955 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:11.249916 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:11.319990 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:11.319969 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:15:11.464198 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:11.464136 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" event={"ID":"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2","Type":"ContainerStarted","Data":"9c7585979770a6b42187ccc633e467de7c4fcfaccb7e968df50a04f09cfeda23"} Jul 06 20:15:11.465566 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:11.465535 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wlkqd" event={"ID":"d090ec73-b76e-4e0e-b7ae-860b9c17c792","Type":"ContainerStarted","Data":"0992e980d800d1bb176fce09ab335e323b0338ff59ce454774d741bcd2c8417a"} Jul 06 20:15:11.467577 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:11.467520 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" event={"ID":"897d6bcf4199302dfb88bc40b83b5bcb","Type":"ContainerStarted","Data":"00485325933db556c6fd31f6038abfeff67a96674e85bf67a10ffb206be674d6"} Jul 06 20:15:11.486926 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:11.486889 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wlkqd" podStartSLOduration=4.108710767 podStartE2EDuration="23.486874506s" totalImagesPullingTime="19.378163739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:11.486741496 +0000 UTC m=+23.819729355" watchObservedRunningTime="2026-07-06 20:15:11.486874506 +0000 UTC m=+23.819862365" Jul 06 20:15:11.525844 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:11.525801 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-202.ec2.internal" podStartSLOduration=1.525785487 podStartE2EDuration="1.525785487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:11.52544169 +0000 UTC m=+23.858429548" watchObservedRunningTime="2026-07-06 20:15:11.525785487 +0000 UTC m=+23.858773346" Jul 06 20:15:12.152633 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:12.152335 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:15:11.319987813Z","UUID":"0b8361ac-6150-4537-a757-a660277c3b21","Handler":null,"Name":"","Endpoint":""} Jul 06 20:15:12.154220 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:12.154194 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:15:12.154367 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:12.154242 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:15:12.249905 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:12.249835 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:12.250049 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:12.249952 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:12.473476 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:12.473439 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"8b19566c674aba594c6c612d2738de1eb8343660fd2db3dafb4f5f20da65e6c1"} Jul 06 20:15:13.249440 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:13.249407 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:13.249632 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:13.249415 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:13.249632 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:13.249536 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:13.249632 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:13.249577 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:13.384028 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:13.384002 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:15:13.384574 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:13.384533 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:15:13.476816 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:13.476786 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" event={"ID":"11e6c5dc-6048-47c3-8d25-6d26d0c2e1e2","Type":"ContainerStarted","Data":"1cda118e3c90732cbfc872e46b7526222da205e343098e6c91727a4184b4a885"} Jul 06 20:15:13.477191 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:13.477083 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:15:13.477509 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:13.477495 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mrtnc" Jul 06 20:15:13.511775 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:13.511716 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hrbbm" podStartSLOduration=3.54645603 podStartE2EDuration="25.511703412s" totalImagesPullingTime="21.965247382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:13.511358753 +0000 UTC m=+25.844346611" watchObservedRunningTime="2026-07-06 20:15:13.511703412 +0000 UTC m=+25.844691271" Jul 06 20:15:14.249326 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:14.249035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:14.249517 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:14.249425 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:14.482751 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:14.482710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" event={"ID":"424aaa02-561c-4ec7-bd22-62ec14eb4678","Type":"ContainerStarted","Data":"2d26fbc0236d24b6387d813aafb6ebc79d937c22795c9c02aa6c1e5713dfc683"} Jul 06 20:15:15.249287 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:15.249256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:15.249469 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:15.249370 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:15.249469 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:15.249428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:15.249593 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:15.249525 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:15.484671 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:15.484634 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:15:15.485044 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:15.484719 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:15:15.485044 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:15.484770 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:15:15.498842 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:15.498814 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:15:15.499009 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:15.498991 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:15:15.539498 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:15.539414 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" podStartSLOduration=7.881647162 podStartE2EDuration="27.53940101s" totalImagesPullingTime="19.657753848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:14.527946826 +0000 UTC m=+26.860934709" watchObservedRunningTime="2026-07-06 20:15:15.53940101 +0000 UTC m=+27.872388846" Jul 06 20:15:16.253078 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:16.253051 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:16.253261 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:16.253152 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:17.249543 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:17.249508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:17.249543 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:17.249529 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:17.250033 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:17.249628 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:17.250033 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:17.249779 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:18.250297 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:18.250264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:18.250764 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:18.250361 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:18.493116 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:18.493078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerStarted","Data":"cb9e58563a3a1410fe93e747c3fa4afad655012e105d4a9fb576aab6cbac1eb4"} Jul 06 20:15:19.249007 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:19.248829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:19.249148 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:19.248886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:19.249148 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:19.249080 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:19.249236 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:19.249149 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:19.496924 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:19.496900 2559 generic.go:356] "Generic (PLEG): container finished" podID="8e29849a-478b-472c-9c4f-bdc4a2eb8280" containerID="cb9e58563a3a1410fe93e747c3fa4afad655012e105d4a9fb576aab6cbac1eb4" exitCode=0 Jul 06 20:15:19.497253 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:19.496954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerDied","Data":"cb9e58563a3a1410fe93e747c3fa4afad655012e105d4a9fb576aab6cbac1eb4"} Jul 06 20:15:20.249225 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:20.249205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:20.249313 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.249300 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:20.500772 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:20.500706 2559 generic.go:356] "Generic (PLEG): container finished" podID="8e29849a-478b-472c-9c4f-bdc4a2eb8280" containerID="98707138e4eb88e176501c361e2a5254d27716c6716a1b1e4d5c21631fcc5c94" exitCode=0 Jul 06 20:15:20.500772 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:20.500750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerDied","Data":"98707138e4eb88e176501c361e2a5254d27716c6716a1b1e4d5c21631fcc5c94"} Jul 06 20:15:20.828622 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:20.828553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:20.828724 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.828674 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:15:20.828758 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.828724 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret podName:9e3177b7-2789-4fe3-9c3c-26949144b765 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:52.828710275 +0000 UTC m=+65.161698111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret") pod "global-pull-secret-syncer-t8dz6" (UID: "9e3177b7-2789-4fe3-9c3c-26949144b765") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:15:20.929702 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:20.929677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:20.929702 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:20.929705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:20.929839 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.929780 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:15:20.929839 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.929809 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:15:20.929839 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.929820 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs podName:85d46691-3809-443c-8a0c-b955a8de3992 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:52.929809335 +0000 UTC m=+65.262797174 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs") pod "network-metrics-daemon-4448z" (UID: "85d46691-3809-443c-8a0c-b955a8de3992") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:15:20.929839 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.929825 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:15:20.929839 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.929834 2559 projected.go:196] Error preparing data for projected volume kube-api-access-zxhkm for pod openshift-network-diagnostics/network-check-target-8lgdr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:15:20.930005 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:20.929866 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm podName:b80e5002-f2ac-425b-9c81-73eaf072ea4d nodeName:}" failed. No retries permitted until 2026-07-06 20:15:52.9298551 +0000 UTC m=+65.262842935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxhkm" (UniqueName: "kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm") pod "network-check-target-8lgdr" (UID: "b80e5002-f2ac-425b-9c81-73eaf072ea4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:15:21.248971 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:21.248952 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:21.249055 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:21.248970 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:21.249089 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:21.249052 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:21.249130 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:21.249116 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:21.504545 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:21.504485 2559 generic.go:356] "Generic (PLEG): container finished" podID="8e29849a-478b-472c-9c4f-bdc4a2eb8280" containerID="0b3147ae71d40a72509e6ce3eee9e38354383857686a7a3e0aeb91bebd1c825d" exitCode=0 Jul 06 20:15:21.504545 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:21.504519 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerDied","Data":"0b3147ae71d40a72509e6ce3eee9e38354383857686a7a3e0aeb91bebd1c825d"} Jul 06 20:15:22.249582 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:22.249539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:22.249881 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:22.249656 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:23.249221 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:23.249191 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:23.249609 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:23.249301 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:23.249609 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:23.249351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:23.249609 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:23.249429 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:24.249639 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:24.249613 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:24.250000 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:24.249712 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:25.249746 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:25.249707 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:25.250162 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:25.249717 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:25.250162 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:25.249851 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:25.250162 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:25.249883 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:26.249412 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:26.249379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:26.249601 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:26.249532 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:27.248925 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:27.248893 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:27.249389 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:27.249008 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:27.249389 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:27.249069 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:27.249389 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:27.249179 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:28.249976 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:28.249947 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:28.250385 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:28.250043 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:28.520263 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:28.520181 2559 generic.go:356] "Generic (PLEG): container finished" podID="8e29849a-478b-472c-9c4f-bdc4a2eb8280" containerID="3a03f65ad30cfd03817d14ea3d6665dffad8638e62ac7ba288d65fca2b6aa1cd" exitCode=0 Jul 06 20:15:28.520263 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:28.520241 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerDied","Data":"3a03f65ad30cfd03817d14ea3d6665dffad8638e62ac7ba288d65fca2b6aa1cd"} Jul 06 20:15:29.249442 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:29.249400 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:29.249650 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:29.249451 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:29.249650 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:29.249517 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:29.249784 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:29.249652 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:29.525279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:29.525201 2559 generic.go:356] "Generic (PLEG): container finished" podID="8e29849a-478b-472c-9c4f-bdc4a2eb8280" containerID="b69810070c914242b40eb85b140f4c6d68c5fb5db6e07ca238ac8ea7e4f68fca" exitCode=0 Jul 06 20:15:29.525279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:29.525255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerDied","Data":"b69810070c914242b40eb85b140f4c6d68c5fb5db6e07ca238ac8ea7e4f68fca"} Jul 06 20:15:30.249006 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:30.248971 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:30.249144 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:30.249069 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:30.530764 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:30.530680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" event={"ID":"8e29849a-478b-472c-9c4f-bdc4a2eb8280","Type":"ContainerStarted","Data":"4691ad2c410900c7000bd1003548b025b4a58fe2feb9f92a2747e2f2da1d35c9"} Jul 06 20:15:30.555463 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:30.555420 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wrn2h" podStartSLOduration=12.560173778 podStartE2EDuration="42.555404144s" totalImagesPullingTime="29.995230366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:30.553468132 +0000 UTC m=+42.886455989" watchObservedRunningTime="2026-07-06 20:15:30.555404144 +0000 UTC m=+42.888392001" Jul 06 20:15:31.249063 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:31.249025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:31.249063 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:31.249050 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:31.249279 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:31.249129 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:31.249279 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:31.249241 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:32.249094 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:32.249063 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:32.249602 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:32.249234 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:33.248705 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:33.248676 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:33.248862 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:33.248770 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:33.248862 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:33.248827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:33.248933 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:33.248901 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:34.249737 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:34.249710 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:34.250099 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:34.249801 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:35.249671 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:35.249642 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:35.249834 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:35.249656 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:35.250180 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:35.249875 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:35.250180 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:35.249927 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:35.439541 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:35.439372 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8dz6"] Jul 06 20:15:35.439719 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:35.439646 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:35.439789 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:35.439729 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:35.443013 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:35.442972 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8lgdr"] Jul 06 20:15:35.443746 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:35.443720 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4448z"] Jul 06 20:15:35.541743 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:35.541680 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:35.541890 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:35.541680 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:35.541890 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:35.541774 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:35.541890 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:35.541856 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:37.249304 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:37.249267 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:37.249772 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:37.249356 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lgdr" podUID="b80e5002-f2ac-425b-9c81-73eaf072ea4d" Jul 06 20:15:37.249772 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:37.249279 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:37.249772 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:37.249399 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:37.249772 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:37.249474 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4448z" podUID="85d46691-3809-443c-8a0c-b955a8de3992" Jul 06 20:15:37.249772 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:37.249531 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8dz6" podUID="9e3177b7-2789-4fe3-9c3c-26949144b765" Jul 06 20:15:38.978327 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:38.978268 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeReady" Jul 06 20:15:38.978783 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:38.978360 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:15:39.043207 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.043183 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sr2lw"] Jul 06 20:15:39.056682 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.056664 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rwpsq"] Jul 06 20:15:39.056792 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.056776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.060538 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.060500 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hk74q\"" Jul 06 20:15:39.060538 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.060519 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:15:39.060710 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.060520 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:15:39.070803 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.070786 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sr2lw"] Jul 06 20:15:39.070884 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.070814 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rwpsq"] Jul 06 20:15:39.070884 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.070881 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rwpsq" Jul 06 20:15:39.073492 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.073475 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:15:39.073595 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.073523 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:15:39.073595 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.073538 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:15:39.073595 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.073586 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9vhmq\"" Jul 06 20:15:39.163102 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.163072 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dd9a95-6a90-4349-9cc5-fe33b8cec27a-cert\") pod \"ingress-canary-rwpsq\" (UID: \"13dd9a95-6a90-4349-9cc5-fe33b8cec27a\") " pod="openshift-ingress-canary/ingress-canary-rwpsq" Jul 06 20:15:39.163102 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.163104 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-config-volume\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.163323 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.163121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj82q\" (UniqueName: \"kubernetes.io/projected/13dd9a95-6a90-4349-9cc5-fe33b8cec27a-kube-api-access-bj82q\") pod \"ingress-canary-rwpsq\" (UID: \"13dd9a95-6a90-4349-9cc5-fe33b8cec27a\") " pod="openshift-ingress-canary/ingress-canary-rwpsq" Jul 06 20:15:39.163323 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.163136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-tmp-dir\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.163323 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.163150 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-metrics-tls\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.163323 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.163252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqtd\" (UniqueName: \"kubernetes.io/projected/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-kube-api-access-5fqtd\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.249129 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.249038 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:39.249129 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.249053 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:39.249129 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.249049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:39.252372 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.252349 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ksdkk\"" Jul 06 20:15:39.252372 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.252356 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:15:39.252551 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.252455 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:15:39.252551 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.252473 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:15:39.253434 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.253405 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8g8p6\"" Jul 06 20:15:39.253519 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.253441 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:15:39.263822 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.263799 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dd9a95-6a90-4349-9cc5-fe33b8cec27a-cert\") pod \"ingress-canary-rwpsq\" (UID: \"13dd9a95-6a90-4349-9cc5-fe33b8cec27a\") " pod="openshift-ingress-canary/ingress-canary-rwpsq" Jul 06 20:15:39.263914 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.263840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-config-volume\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.263914 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.263872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj82q\" (UniqueName: \"kubernetes.io/projected/13dd9a95-6a90-4349-9cc5-fe33b8cec27a-kube-api-access-bj82q\") pod \"ingress-canary-rwpsq\" (UID: \"13dd9a95-6a90-4349-9cc5-fe33b8cec27a\") " pod="openshift-ingress-canary/ingress-canary-rwpsq" Jul 06 20:15:39.263914 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.263897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-tmp-dir\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.264033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.263923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-metrics-tls\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.264193 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.264177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqtd\" (UniqueName: \"kubernetes.io/projected/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-kube-api-access-5fqtd\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.264289 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.264256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-tmp-dir\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.264582 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.264549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-config-volume\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.267900 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.267881 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-metrics-tls\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.268008 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.267994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dd9a95-6a90-4349-9cc5-fe33b8cec27a-cert\") pod \"ingress-canary-rwpsq\" (UID: \"13dd9a95-6a90-4349-9cc5-fe33b8cec27a\") " pod="openshift-ingress-canary/ingress-canary-rwpsq" Jul 06 20:15:39.272993 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.272959 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqtd\" (UniqueName: \"kubernetes.io/projected/3816a3b4-5ad7-418b-86a1-403fd1c72bdc-kube-api-access-5fqtd\") pod \"dns-default-sr2lw\" (UID: \"3816a3b4-5ad7-418b-86a1-403fd1c72bdc\") " pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.273109 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.273094 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj82q\" (UniqueName: \"kubernetes.io/projected/13dd9a95-6a90-4349-9cc5-fe33b8cec27a-kube-api-access-bj82q\") pod \"ingress-canary-rwpsq\" (UID: \"13dd9a95-6a90-4349-9cc5-fe33b8cec27a\") " pod="openshift-ingress-canary/ingress-canary-rwpsq" Jul 06 20:15:39.367510 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.367493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:39.379411 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.379388 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rwpsq" Jul 06 20:15:39.567533 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.567376 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rwpsq"] Jul 06 20:15:39.571270 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:39.571124 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13dd9a95_6a90_4349_9cc5_fe33b8cec27a.slice/crio-24e62bf879584b0576be61adb97839210c3b164dbfa804b9ec1b11d5b87664fa WatchSource:0}: Error finding container 24e62bf879584b0576be61adb97839210c3b164dbfa804b9ec1b11d5b87664fa: Status 404 returned error can't find the container with id 24e62bf879584b0576be61adb97839210c3b164dbfa804b9ec1b11d5b87664fa Jul 06 20:15:39.572008 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:39.571984 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sr2lw"] Jul 06 20:15:39.576161 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:39.576133 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3816a3b4_5ad7_418b_86a1_403fd1c72bdc.slice/crio-b655e53b3f99a2da2b60c33e7bf29c44f4ef9a234bd3ea5d1abf2ca3540ef753 WatchSource:0}: Error finding container b655e53b3f99a2da2b60c33e7bf29c44f4ef9a234bd3ea5d1abf2ca3540ef753: Status 404 returned error can't find the container with id b655e53b3f99a2da2b60c33e7bf29c44f4ef9a234bd3ea5d1abf2ca3540ef753 Jul 06 20:15:40.554052 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:40.554018 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rwpsq" event={"ID":"13dd9a95-6a90-4349-9cc5-fe33b8cec27a","Type":"ContainerStarted","Data":"24e62bf879584b0576be61adb97839210c3b164dbfa804b9ec1b11d5b87664fa"} Jul 06 20:15:40.555055 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:40.555035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr2lw" event={"ID":"3816a3b4-5ad7-418b-86a1-403fd1c72bdc","Type":"ContainerStarted","Data":"b655e53b3f99a2da2b60c33e7bf29c44f4ef9a234bd3ea5d1abf2ca3540ef753"} Jul 06 20:15:42.561152 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:42.561111 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr2lw" event={"ID":"3816a3b4-5ad7-418b-86a1-403fd1c72bdc","Type":"ContainerStarted","Data":"28eb024da6ff042175e7e88292aaed7570b1485553530cc68d8c15a7fa8f9340"} Jul 06 20:15:42.561646 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:42.561179 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr2lw" event={"ID":"3816a3b4-5ad7-418b-86a1-403fd1c72bdc","Type":"ContainerStarted","Data":"901f6798558e99f687e9ad81e2fc99a84631f6ad8a702c8389be019888bdfddb"} Jul 06 20:15:42.561646 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:42.561226 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:42.580418 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:42.580372 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sr2lw" podStartSLOduration=1.414987132 podStartE2EDuration="3.580356385s" totalImagesPullingTime="2.165369253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:42.579575295 +0000 UTC m=+54.912563174" watchObservedRunningTime="2026-07-06 20:15:42.580356385 +0000 UTC m=+54.913344249" Jul 06 20:15:43.565462 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:43.565276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rwpsq" event={"ID":"13dd9a95-6a90-4349-9cc5-fe33b8cec27a","Type":"ContainerStarted","Data":"689f0af8aa242da50961b85c780319863e39236ae1670eb809e1b874d12c2c83"} Jul 06 20:15:43.583785 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:43.583742 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rwpsq" podStartSLOduration=1.360364377 podStartE2EDuration="4.58372758s" totalImagesPullingTime="3.223363203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:43.582284185 +0000 UTC m=+55.915272043" watchObservedRunningTime="2026-07-06 20:15:43.58372758 +0000 UTC m=+55.916715438" Jul 06 20:15:44.128397 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.128366 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg"] Jul 06 20:15:44.130425 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.130411 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" Jul 06 20:15:44.133996 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.133978 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gb6vl\"" Jul 06 20:15:44.134207 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.134190 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 20:15:44.144632 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.144613 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg"] Jul 06 20:15:44.200135 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.200108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5752db4c-8e5d-4748-ab90-2e238161c17d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xj7pg\" (UID: \"5752db4c-8e5d-4748-ab90-2e238161c17d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" Jul 06 20:15:44.288071 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.288049 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2jwrj"] Jul 06 20:15:44.290272 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.290259 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.292997 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.292968 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:15:44.293306 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.293288 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:15:44.294278 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.294261 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xjp7h\"" Jul 06 20:15:44.295440 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.295422 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:15:44.295527 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.295474 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:15:44.301068 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.301050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5752db4c-8e5d-4748-ab90-2e238161c17d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xj7pg\" (UID: \"5752db4c-8e5d-4748-ab90-2e238161c17d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" Jul 06 20:15:44.301170 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:44.301159 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 20:15:44.301224 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:44.301215 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5752db4c-8e5d-4748-ab90-2e238161c17d-tls-certificates podName:5752db4c-8e5d-4748-ab90-2e238161c17d nodeName:}" failed. No retries permitted until 2026-07-06 20:15:44.801193821 +0000 UTC m=+57.134181657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5752db4c-8e5d-4748-ab90-2e238161c17d-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-xj7pg" (UID: "5752db4c-8e5d-4748-ab90-2e238161c17d") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 20:15:44.307849 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.307829 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2jwrj"] Jul 06 20:15:44.401744 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.401688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vbpb\" (UniqueName: \"kubernetes.io/projected/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-api-access-8vbpb\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.401849 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.401751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a16de382-e7f5-40cd-b812-a42a61bdc146-crio-socket\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.401849 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.401780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a16de382-e7f5-40cd-b812-a42a61bdc146-data-volume\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.401849 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.401805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.401849 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.401820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.502268 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.502241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a16de382-e7f5-40cd-b812-a42a61bdc146-crio-socket\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.502380 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.502282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a16de382-e7f5-40cd-b812-a42a61bdc146-data-volume\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.502380 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.502309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.502380 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.502323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.502380 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.502352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vbpb\" (UniqueName: \"kubernetes.io/projected/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-api-access-8vbpb\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.502506 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:44.502415 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:15:44.502506 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:44.502472 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:15:44.502506 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:44.502490 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-rbac-proxy-cm podName:a16de382-e7f5-40cd-b812-a42a61bdc146 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:45.002473145 +0000 UTC m=+57.335460982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2jwrj" (UID: "a16de382-e7f5-40cd-b812-a42a61bdc146") : configmap "kube-rbac-proxy" not found Jul 06 20:15:44.502644 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.502521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a16de382-e7f5-40cd-b812-a42a61bdc146-crio-socket\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.502644 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:44.502592 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls podName:a16de382-e7f5-40cd-b812-a42a61bdc146 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:45.002539336 +0000 UTC m=+57.335527175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2jwrj" (UID: "a16de382-e7f5-40cd-b812-a42a61bdc146") : secret "insights-runtime-extractor-tls" not found Jul 06 20:15:44.502722 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.502706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a16de382-e7f5-40cd-b812-a42a61bdc146-data-volume\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.513049 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.513021 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vbpb\" (UniqueName: \"kubernetes.io/projected/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-api-access-8vbpb\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:44.805198 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.805170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5752db4c-8e5d-4748-ab90-2e238161c17d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xj7pg\" (UID: \"5752db4c-8e5d-4748-ab90-2e238161c17d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" Jul 06 20:15:44.807349 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:44.807326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5752db4c-8e5d-4748-ab90-2e238161c17d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xj7pg\" (UID: \"5752db4c-8e5d-4748-ab90-2e238161c17d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" Jul 06 20:15:45.006745 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:45.006721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:45.006850 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:45.006751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:45.006896 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:45.006883 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:15:45.006944 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:45.006936 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls podName:a16de382-e7f5-40cd-b812-a42a61bdc146 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:46.00692386 +0000 UTC m=+58.339911695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2jwrj" (UID: "a16de382-e7f5-40cd-b812-a42a61bdc146") : secret "insights-runtime-extractor-tls" not found Jul 06 20:15:45.007246 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:45.007228 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a16de382-e7f5-40cd-b812-a42a61bdc146-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:45.039197 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:45.039165 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" Jul 06 20:15:45.170096 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:45.170067 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg"] Jul 06 20:15:45.173677 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:45.173647 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5752db4c_8e5d_4748_ab90_2e238161c17d.slice/crio-45ac0326f429973b6ce8ef8e867c03024cde5591aabbd32d9d0ec0efedc7b9a9 WatchSource:0}: Error finding container 45ac0326f429973b6ce8ef8e867c03024cde5591aabbd32d9d0ec0efedc7b9a9: Status 404 returned error can't find the container with id 45ac0326f429973b6ce8ef8e867c03024cde5591aabbd32d9d0ec0efedc7b9a9 Jul 06 20:15:45.571594 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:45.571552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" event={"ID":"5752db4c-8e5d-4748-ab90-2e238161c17d","Type":"ContainerStarted","Data":"45ac0326f429973b6ce8ef8e867c03024cde5591aabbd32d9d0ec0efedc7b9a9"} Jul 06 20:15:46.012957 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.012913 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:46.015074 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.015055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a16de382-e7f5-40cd-b812-a42a61bdc146-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jwrj\" (UID: \"a16de382-e7f5-40cd-b812-a42a61bdc146\") " pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:46.098380 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.098354 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2jwrj" Jul 06 20:15:46.241415 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.241383 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2jwrj"] Jul 06 20:15:46.398573 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:46.398475 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16de382_e7f5_40cd_b812_a42a61bdc146.slice/crio-865c09446db92a4de13e57e9a10f6c63818c731bb48de331f70c3b7d40f5714c WatchSource:0}: Error finding container 865c09446db92a4de13e57e9a10f6c63818c731bb48de331f70c3b7d40f5714c: Status 404 returned error can't find the container with id 865c09446db92a4de13e57e9a10f6c63818c731bb48de331f70c3b7d40f5714c Jul 06 20:15:46.575033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.575006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jwrj" event={"ID":"a16de382-e7f5-40cd-b812-a42a61bdc146","Type":"ContainerStarted","Data":"865c09446db92a4de13e57e9a10f6c63818c731bb48de331f70c3b7d40f5714c"} Jul 06 20:15:46.576319 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.576296 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" event={"ID":"5752db4c-8e5d-4748-ab90-2e238161c17d","Type":"ContainerStarted","Data":"c31c27d48b823756fa2b026b736211cb0afca5e2a411145bbe2c73818728e27d"} Jul 06 20:15:46.576511 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.576492 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" Jul 06 20:15:46.580945 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.580925 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" Jul 06 20:15:46.594185 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:46.594143 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xj7pg" podStartSLOduration=1.343952176 podStartE2EDuration="2.594129855s" totalImagesPullingTime="1.250177679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:46.593612154 +0000 UTC m=+58.926600030" watchObservedRunningTime="2026-07-06 20:15:46.594129855 +0000 UTC m=+58.927117712" Jul 06 20:15:47.199341 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.198056 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf"] Jul 06 20:15:47.201595 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.200674 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.204628 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.204607 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 20:15:47.204751 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.204642 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 20:15:47.205050 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.205032 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:15:47.205508 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.205492 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:15:47.206654 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.206436 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:15:47.206654 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.206650 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pkfc8\"" Jul 06 20:15:47.213284 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.213265 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf"] Jul 06 20:15:47.222203 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.222178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.222304 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.222218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.222304 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.222261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9gh7\" (UniqueName: \"kubernetes.io/projected/1b553056-f01c-4a9f-9394-1e825601d1b7-kube-api-access-v9gh7\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.222402 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.222369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b553056-f01c-4a9f-9394-1e825601d1b7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.323152 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.323114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.323152 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.323151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.323353 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.323185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gh7\" (UniqueName: \"kubernetes.io/projected/1b553056-f01c-4a9f-9394-1e825601d1b7-kube-api-access-v9gh7\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.323353 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.323248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b553056-f01c-4a9f-9394-1e825601d1b7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.323890 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:47.323655 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 20:15:47.323890 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:47.323706 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls podName:1b553056-f01c-4a9f-9394-1e825601d1b7 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:47.823692952 +0000 UTC m=+60.156680788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-jkbcf" (UID: "1b553056-f01c-4a9f-9394-1e825601d1b7") : secret "prometheus-operator-tls" not found Jul 06 20:15:47.324519 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.324499 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b553056-f01c-4a9f-9394-1e825601d1b7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.326959 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.326925 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.333569 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.333512 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gh7\" (UniqueName: \"kubernetes.io/projected/1b553056-f01c-4a9f-9394-1e825601d1b7-kube-api-access-v9gh7\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.501271 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.501208 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qdff" Jul 06 20:15:47.719216 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.719191 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sr2lw_3816a3b4-5ad7-418b-86a1-403fd1c72bdc/dns/0.log" Jul 06 20:15:47.828944 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.828880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:47.829426 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:47.829389 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 20:15:47.829579 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:47.829475 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls podName:1b553056-f01c-4a9f-9394-1e825601d1b7 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:48.829455551 +0000 UTC m=+61.162443407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-jkbcf" (UID: "1b553056-f01c-4a9f-9394-1e825601d1b7") : secret "prometheus-operator-tls" not found Jul 06 20:15:47.903734 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:47.903692 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sr2lw_3816a3b4-5ad7-418b-86a1-403fd1c72bdc/kube-rbac-proxy/0.log" Jul 06 20:15:48.837326 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:48.837290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:48.840096 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:48.840067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b553056-f01c-4a9f-9394-1e825601d1b7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jkbcf\" (UID: \"1b553056-f01c-4a9f-9394-1e825601d1b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:48.899620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:48.899595 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkg85_9e7b2cad-a984-4426-b072-a2eecc88de95/dns-node-resolver/0.log" Jul 06 20:15:49.017390 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:49.017359 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pkfc8\"" Jul 06 20:15:49.024513 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:49.024490 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" Jul 06 20:15:49.701043 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:49.701014 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qpjz2_9e4458c9-0214-4543-a480-3192c30f0e18/node-ca/0.log" Jul 06 20:15:50.108343 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:50.108321 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf"] Jul 06 20:15:50.111464 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:50.111437 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b553056_f01c_4a9f_9394_1e825601d1b7.slice/crio-4834bbcd96b365b65086b7713ed99d895e42b34e4f5225ac84e5ce58bf7da5dd WatchSource:0}: Error finding container 4834bbcd96b365b65086b7713ed99d895e42b34e4f5225ac84e5ce58bf7da5dd: Status 404 returned error can't find the container with id 4834bbcd96b365b65086b7713ed99d895e42b34e4f5225ac84e5ce58bf7da5dd Jul 06 20:15:50.588718 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:50.588680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jwrj" event={"ID":"a16de382-e7f5-40cd-b812-a42a61bdc146","Type":"ContainerStarted","Data":"599607e8638f78b12cc79ea2dad8bb0086e179af938023eb0d27a59abe0e71fc"} Jul 06 20:15:50.589955 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:50.589913 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" event={"ID":"1b553056-f01c-4a9f-9394-1e825601d1b7","Type":"ContainerStarted","Data":"4834bbcd96b365b65086b7713ed99d895e42b34e4f5225ac84e5ce58bf7da5dd"} Jul 06 20:15:50.701726 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:50.701699 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rwpsq_13dd9a95-6a90-4349-9cc5-fe33b8cec27a/serve-healthcheck-canary/0.log" Jul 06 20:15:51.596422 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:51.596388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jwrj" event={"ID":"a16de382-e7f5-40cd-b812-a42a61bdc146","Type":"ContainerStarted","Data":"4d47b81889db70bcfeee68ec1097d65c72bb5863dfaa07b1a745cd99496a1f01"} Jul 06 20:15:52.567957 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.567923 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sr2lw" Jul 06 20:15:52.602782 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.602750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" event={"ID":"1b553056-f01c-4a9f-9394-1e825601d1b7","Type":"ContainerStarted","Data":"5a749535ad0c5c3e50dde1be38d14fc8c8660bff76c81475e32a602fa232de2e"} Jul 06 20:15:52.603188 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.602810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" event={"ID":"1b553056-f01c-4a9f-9394-1e825601d1b7","Type":"ContainerStarted","Data":"97e4da8d0b71df7af8f0da642614687f2f77040534c7ef32ec50ab58949c9153"} Jul 06 20:15:52.621286 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.621231 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkbcf" podStartSLOduration=4.169145893 podStartE2EDuration="5.621212942s" totalImagesPullingTime="1.452067049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:52.620787705 +0000 UTC m=+64.953775567" watchObservedRunningTime="2026-07-06 20:15:52.621212942 +0000 UTC m=+64.954200801" Jul 06 20:15:52.870070 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.869994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:52.873415 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.873391 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:15:52.883279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.883255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e3177b7-2789-4fe3-9c3c-26949144b765-original-pull-secret\") pod \"global-pull-secret-syncer-t8dz6\" (UID: \"9e3177b7-2789-4fe3-9c3c-26949144b765\") " pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:52.971274 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.971240 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:52.971501 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.971296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:52.974545 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.974525 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:15:52.974671 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.974594 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:15:52.984232 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.984212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85d46691-3809-443c-8a0c-b955a8de3992-metrics-certs\") pod \"network-metrics-daemon-4448z\" (UID: \"85d46691-3809-443c-8a0c-b955a8de3992\") " pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:52.984794 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.984777 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:15:52.994721 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:52.994703 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxhkm\" (UniqueName: \"kubernetes.io/projected/b80e5002-f2ac-425b-9c81-73eaf072ea4d-kube-api-access-zxhkm\") pod \"network-check-target-8lgdr\" (UID: \"b80e5002-f2ac-425b-9c81-73eaf072ea4d\") " pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:53.061831 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.061805 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ksdkk\"" Jul 06 20:15:53.066623 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.066584 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8g8p6\"" Jul 06 20:15:53.069783 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.069759 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4448z" Jul 06 20:15:53.075138 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.075106 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:53.081643 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.081623 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8dz6" Jul 06 20:15:53.355689 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.355662 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8lgdr"] Jul 06 20:15:53.358519 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:53.358495 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80e5002_f2ac_425b_9c81_73eaf072ea4d.slice/crio-7bb6d3b841948a3a04e03aa51001cc99c808e13cd5c86f52d77dd42a51f62c06 WatchSource:0}: Error finding container 7bb6d3b841948a3a04e03aa51001cc99c808e13cd5c86f52d77dd42a51f62c06: Status 404 returned error can't find the container with id 7bb6d3b841948a3a04e03aa51001cc99c808e13cd5c86f52d77dd42a51f62c06 Jul 06 20:15:53.577013 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.573441 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8dz6"] Jul 06 20:15:53.578643 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.578525 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4448z"] Jul 06 20:15:53.580528 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:53.580505 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d46691_3809_443c_8a0c_b955a8de3992.slice/crio-1cbff05ee458a510f191b2841a834146dd3d5e4dc479a7cd670402bdc7943193 WatchSource:0}: Error finding container 1cbff05ee458a510f191b2841a834146dd3d5e4dc479a7cd670402bdc7943193: Status 404 returned error can't find the container with id 1cbff05ee458a510f191b2841a834146dd3d5e4dc479a7cd670402bdc7943193 Jul 06 20:15:53.606525 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.606493 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8lgdr" event={"ID":"b80e5002-f2ac-425b-9c81-73eaf072ea4d","Type":"ContainerStarted","Data":"7bb6d3b841948a3a04e03aa51001cc99c808e13cd5c86f52d77dd42a51f62c06"} Jul 06 20:15:53.607488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.607468 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4448z" event={"ID":"85d46691-3809-443c-8a0c-b955a8de3992","Type":"ContainerStarted","Data":"1cbff05ee458a510f191b2841a834146dd3d5e4dc479a7cd670402bdc7943193"} Jul 06 20:15:53.608443 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.608422 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8dz6" event={"ID":"9e3177b7-2789-4fe3-9c3c-26949144b765","Type":"ContainerStarted","Data":"1a6b4b989fbbaaf6056aacaaf36b8fbbfa0af98666eea69c45e16561b8c4c540"} Jul 06 20:15:53.610400 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.610381 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jwrj" event={"ID":"a16de382-e7f5-40cd-b812-a42a61bdc146","Type":"ContainerStarted","Data":"c9a4f45eb71e7a6cb04b4a8d76260f709a9fd72e03f9dc664f3e722a27e2ab85"} Jul 06 20:15:53.630881 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:53.630836 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2jwrj" podStartSLOduration=2.919298421 podStartE2EDuration="9.630821005s" totalImagesPullingTime="6.711522584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:15:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:53.630450481 +0000 UTC m=+65.963438339" watchObservedRunningTime="2026-07-06 20:15:53.630821005 +0000 UTC m=+65.963808864" Jul 06 20:15:54.609261 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.609226 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-45p4r"] Jul 06 20:15:54.612425 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.612405 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.616435 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.616265 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:15:54.616539 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.616516 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97kgv\"" Jul 06 20:15:54.617583 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.617202 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:15:54.617583 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.617416 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:15:54.684412 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9727583-c3b6-4db4-a6c0-8d160972780e-metrics-client-ca\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.684599 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-root\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.684599 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-sys\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.684599 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-wtmp\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.684817 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-tls\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.684817 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-textfile\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.684900 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-accelerators-collector-config\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.684900 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.684971 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.684907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwcpd\" (UniqueName: \"kubernetes.io/projected/c9727583-c3b6-4db4-a6c0-8d160972780e-kube-api-access-kwcpd\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.785959 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.785922 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-accelerators-collector-config\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786144 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.785976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786144 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwcpd\" (UniqueName: \"kubernetes.io/projected/c9727583-c3b6-4db4-a6c0-8d160972780e-kube-api-access-kwcpd\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786144 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786068 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9727583-c3b6-4db4-a6c0-8d160972780e-metrics-client-ca\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786144 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-root\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786144 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-sys\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786374 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786154 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-wtmp\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786374 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-tls\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786374 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-textfile\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786855 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786538 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-root\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786855 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-sys\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786855 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786628 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-textfile\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786855 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-accelerators-collector-config\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786855 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.786677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-wtmp\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.786855 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:54.786707 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 20:15:54.786855 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:54.786755 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-tls podName:c9727583-c3b6-4db4-a6c0-8d160972780e nodeName:}" failed. No retries permitted until 2026-07-06 20:15:55.286737699 +0000 UTC m=+67.619725536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-tls") pod "node-exporter-45p4r" (UID: "c9727583-c3b6-4db4-a6c0-8d160972780e") : secret "node-exporter-tls" not found Jul 06 20:15:54.787216 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.787006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9727583-c3b6-4db4-a6c0-8d160972780e-metrics-client-ca\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.789964 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.789938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:54.809428 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:54.809204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwcpd\" (UniqueName: \"kubernetes.io/projected/c9727583-c3b6-4db4-a6c0-8d160972780e-kube-api-access-kwcpd\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:55.292075 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.292030 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-tls\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:55.294713 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.294685 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9727583-c3b6-4db4-a6c0-8d160972780e-node-exporter-tls\") pod \"node-exporter-45p4r\" (UID: \"c9727583-c3b6-4db4-a6c0-8d160972780e\") " pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:55.525746 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.525709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-45p4r" Jul 06 20:15:55.622382 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.622297 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4448z" event={"ID":"85d46691-3809-443c-8a0c-b955a8de3992","Type":"ContainerStarted","Data":"af98878e437b9f2a1c4a73785db341450d76519c51d6db6545206e74657ead69"} Jul 06 20:15:55.622382 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.622359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4448z" event={"ID":"85d46691-3809-443c-8a0c-b955a8de3992","Type":"ContainerStarted","Data":"8e136ae1a83e7d0584b6797e37378fe1c22ab3e610e8b12ab2a8324716ca0f53"} Jul 06 20:15:55.633039 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.633005 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:15:55.635871 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.635840 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.639256 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.639232 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:15:55.639578 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.639402 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:15:55.639578 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.639435 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:15:55.639578 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.639516 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:15:55.639578 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.639519 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:15:55.639852 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.639835 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-njj8l\"" Jul 06 20:15:55.639921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.639894 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:15:55.640044 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.640020 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:15:55.641050 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.641028 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:15:55.641138 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.641102 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:15:55.648320 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.647941 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4448z" podStartSLOduration=66.41888417 podStartE2EDuration="1m7.647918508s" totalImagesPullingTime="1.229034338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:55.646962775 +0000 UTC m=+67.979950633" watchObservedRunningTime="2026-07-06 20:15:55.647918508 +0000 UTC m=+67.980906368" Jul 06 20:15:55.662929 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.662898 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:15:55.695613 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.695574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/366cfd01-b0af-4949-9966-f67b1b08f962-config-out\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.695795 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.695621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-config-volume\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.695795 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.695646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wnv8\" (UniqueName: \"kubernetes.io/projected/366cfd01-b0af-4949-9966-f67b1b08f962-kube-api-access-5wnv8\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.695795 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.695712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.695795 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.695754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.696080 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.696059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.696152 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.696103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.696211 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.696173 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/366cfd01-b0af-4949-9966-f67b1b08f962-tls-assets\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.696211 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.696204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.696305 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.696260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.696549 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.696407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.696549 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.696432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-web-config\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.696549 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.696485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.796973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-web-config\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/366cfd01-b0af-4949-9966-f67b1b08f962-config-out\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-config-volume\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wnv8\" (UniqueName: \"kubernetes.io/projected/366cfd01-b0af-4949-9966-f67b1b08f962-kube-api-access-5wnv8\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797308 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/366cfd01-b0af-4949-9966-f67b1b08f962-tls-assets\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.797801 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.797394 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.800937 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.799025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.800937 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:55.799762 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-trusted-ca-bundle podName:366cfd01-b0af-4949-9966-f67b1b08f962 nodeName:}" failed. No retries permitted until 2026-07-06 20:15:56.299734611 +0000 UTC m=+68.632722448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "366cfd01-b0af-4949-9966-f67b1b08f962") : configmap references non-existent config key: ca-bundle.crt Jul 06 20:15:55.800937 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.800252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.801765 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.801698 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.803071 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.803045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/366cfd01-b0af-4949-9966-f67b1b08f962-config-out\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.803580 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.803540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/366cfd01-b0af-4949-9966-f67b1b08f962-tls-assets\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.803668 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.803551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-config-volume\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.803896 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.803876 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.803978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.803963 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.804512 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.804488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.804884 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.804859 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.805999 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.805977 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/366cfd01-b0af-4949-9966-f67b1b08f962-web-config\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:55.809060 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:55.809040 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wnv8\" (UniqueName: \"kubernetes.io/projected/366cfd01-b0af-4949-9966-f67b1b08f962-kube-api-access-5wnv8\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:56.301616 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.301575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:56.302477 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.302454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366cfd01-b0af-4949-9966-f67b1b08f962-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"366cfd01-b0af-4949-9966-f67b1b08f962\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:56.553665 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.553594 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:15:56.645490 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.645455 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-854d5677b8-qsqcd"] Jul 06 20:15:56.648541 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.648519 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.651750 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.651727 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 20:15:56.651877 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.651788 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z4f6j\"" Jul 06 20:15:56.651963 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.651945 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cv8ipvluvi9c1\"" Jul 06 20:15:56.652036 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.651728 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 20:15:56.652291 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.652273 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 20:15:56.652344 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.652291 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 20:15:56.652913 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.652895 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 20:15:56.661799 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.661776 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-854d5677b8-qsqcd"] Jul 06 20:15:56.704696 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.704660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.704864 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.704712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.704864 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.704807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-tls\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.704864 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.704860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6246649f-4bd9-4d06-a2fb-22ab49a23322-metrics-client-ca\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.705053 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.704901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crzgb\" (UniqueName: \"kubernetes.io/projected/6246649f-4bd9-4d06-a2fb-22ab49a23322-kube-api-access-crzgb\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.705053 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.704927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.705053 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.704996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-grpc-tls\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.705053 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.705027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.806049 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.805954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crzgb\" (UniqueName: \"kubernetes.io/projected/6246649f-4bd9-4d06-a2fb-22ab49a23322-kube-api-access-crzgb\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.806049 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.806016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.806272 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.806055 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-grpc-tls\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.806272 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.806082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.806272 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.806127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.806272 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.806166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.806272 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.806206 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-tls\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.806272 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.806237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6246649f-4bd9-4d06-a2fb-22ab49a23322-metrics-client-ca\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.807086 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.807060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6246649f-4bd9-4d06-a2fb-22ab49a23322-metrics-client-ca\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.809332 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.809304 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.809436 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.809330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-tls\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.809736 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.809716 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.809815 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.809796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-grpc-tls\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.809876 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.809835 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.809876 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.809835 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6246649f-4bd9-4d06-a2fb-22ab49a23322-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.815115 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.815093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crzgb\" (UniqueName: \"kubernetes.io/projected/6246649f-4bd9-4d06-a2fb-22ab49a23322-kube-api-access-crzgb\") pod \"thanos-querier-854d5677b8-qsqcd\" (UID: \"6246649f-4bd9-4d06-a2fb-22ab49a23322\") " pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:56.960230 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:56.960198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:15:57.981436 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:15:57.981278 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9727583_c3b6_4db4_a6c0_8d160972780e.slice/crio-0f81a8822ee5097628359877bd6afacc61fb63654b22d53b186e31a531c29743 WatchSource:0}: Error finding container 0f81a8822ee5097628359877bd6afacc61fb63654b22d53b186e31a531c29743: Status 404 returned error can't find the container with id 0f81a8822ee5097628359877bd6afacc61fb63654b22d53b186e31a531c29743 Jul 06 20:15:58.150307 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.149929 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:15:58.170363 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.170334 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-854d5677b8-qsqcd"] Jul 06 20:15:58.637901 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.637777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" event={"ID":"6246649f-4bd9-4d06-a2fb-22ab49a23322","Type":"ContainerStarted","Data":"f0afb6777e5be16d3c20db1cb7cac3f17c068a52c79b20b22367fe63f1ac19db"} Jul 06 20:15:58.639483 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.639448 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"366cfd01-b0af-4949-9966-f67b1b08f962","Type":"ContainerStarted","Data":"01e499dc54a63b76a532e6f02c90dd127a36c482f295912321812ed665b8bd24"} Jul 06 20:15:58.640663 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.640634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45p4r" event={"ID":"c9727583-c3b6-4db4-a6c0-8d160972780e","Type":"ContainerStarted","Data":"0f81a8822ee5097628359877bd6afacc61fb63654b22d53b186e31a531c29743"} Jul 06 20:15:58.642149 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.642108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8dz6" event={"ID":"9e3177b7-2789-4fe3-9c3c-26949144b765","Type":"ContainerStarted","Data":"eb6068e93289fb9c842143aa7d88a5a884192fba4fd54741f611b24e0b22a596"} Jul 06 20:15:58.643521 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.643496 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8lgdr" event={"ID":"b80e5002-f2ac-425b-9c81-73eaf072ea4d","Type":"ContainerStarted","Data":"62677cd477bb190a305d16f73e30da8e7f2b9b8ed09ab55318fddf265851e18d"} Jul 06 20:15:58.643626 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.643614 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:15:58.659355 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:58.659316 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t8dz6" podStartSLOduration=66.24245224 podStartE2EDuration="1m10.659303292s" totalImagesPullingTime="4.416851052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:58.659168181 +0000 UTC m=+70.992156040" watchObservedRunningTime="2026-07-06 20:15:58.659303292 +0000 UTC m=+70.992291151" Jul 06 20:15:59.355973 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.355915 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8lgdr" podStartSLOduration=66.731593527 podStartE2EDuration="1m11.355896181s" totalImagesPullingTime="4.624302654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:58.680188824 +0000 UTC m=+71.013176695" watchObservedRunningTime="2026-07-06 20:15:59.355896181 +0000 UTC m=+71.688884043" Jul 06 20:15:59.356274 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.356167 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l"] Jul 06 20:15:59.358509 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.358489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:15:59.362052 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.362031 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 20:15:59.362349 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.362326 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lh6mz\"" Jul 06 20:15:59.386633 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.386489 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l"] Jul 06 20:15:59.445123 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.445033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lsx9l\" (UID: \"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:15:59.445123 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.445113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzvrj\" (UniqueName: \"kubernetes.io/projected/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-kube-api-access-zzvrj\") pod \"monitoring-plugin-d5dcff7cf-lsx9l\" (UID: \"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:15:59.546368 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.546340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lsx9l\" (UID: \"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:15:59.546495 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.546403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzvrj\" (UniqueName: \"kubernetes.io/projected/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-kube-api-access-zzvrj\") pod \"monitoring-plugin-d5dcff7cf-lsx9l\" (UID: \"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:15:59.546546 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:59.546489 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 20:15:59.546608 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:15:59.546553 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-monitoring-plugin-cert podName:19b1d595-1b1a-4ecf-ad53-5b9d629a0d82 nodeName:}" failed. No retries permitted until 2026-07-06 20:16:00.046536776 +0000 UTC m=+72.379524612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-lsx9l" (UID: "19b1d595-1b1a-4ecf-ad53-5b9d629a0d82") : secret "monitoring-plugin-cert" not found Jul 06 20:15:59.556401 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.556356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzvrj\" (UniqueName: \"kubernetes.io/projected/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-kube-api-access-zzvrj\") pod \"monitoring-plugin-d5dcff7cf-lsx9l\" (UID: \"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:15:59.650117 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.650033 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45p4r" event={"ID":"c9727583-c3b6-4db4-a6c0-8d160972780e","Type":"ContainerStarted","Data":"3193f0ff0abd7c7f03cb97db62576e5123822d02ec016295db9fabbe692ddcb3"} Jul 06 20:15:59.785107 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.785067 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d8b655f8-2tn4w"] Jul 06 20:15:59.788103 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.788072 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.791269 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.791245 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 20:15:59.791375 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.791267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bphd8\"" Jul 06 20:15:59.791514 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.791501 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 20:15:59.792395 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.792360 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 20:15:59.797197 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.792631 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 20:15:59.797197 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.792969 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 20:15:59.801348 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.801308 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 20:15:59.803839 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.803815 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d8b655f8-2tn4w"] Jul 06 20:15:59.849157 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.849131 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-metrics-client-ca\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.849257 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.849177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-federate-client-tls\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.849313 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.849279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk4fp\" (UniqueName: \"kubernetes.io/projected/24e6acf2-7687-406b-9147-c9ccbf58c7df-kube-api-access-lk4fp\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.849369 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.849348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.849449 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.849390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-secret-telemeter-client\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.849449 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.849417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-serving-certs-ca-bundle\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.849535 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.849472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-telemeter-client-tls\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.849607 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.849528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.950462 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.950434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.950462 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.950468 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-secret-telemeter-client\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.950486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-serving-certs-ca-bundle\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.950522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-telemeter-client-tls\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.950547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.950613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-metrics-client-ca\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.950649 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-federate-client-tls\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.950691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk4fp\" (UniqueName: \"kubernetes.io/projected/24e6acf2-7687-406b-9147-c9ccbf58c7df-kube-api-access-lk4fp\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.951427 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-metrics-client-ca\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951960 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.951625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-serving-certs-ca-bundle\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.951960 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.951656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e6acf2-7687-406b-9147-c9ccbf58c7df-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.953147 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.953126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-secret-telemeter-client\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.953252 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.953202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-telemeter-client-tls\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.953476 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.953453 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.953516 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.953486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/24e6acf2-7687-406b-9147-c9ccbf58c7df-federate-client-tls\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:15:59.962119 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:15:59.962095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk4fp\" (UniqueName: \"kubernetes.io/projected/24e6acf2-7687-406b-9147-c9ccbf58c7df-kube-api-access-lk4fp\") pod \"telemeter-client-7d8b655f8-2tn4w\" (UID: \"24e6acf2-7687-406b-9147-c9ccbf58c7df\") " pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:16:00.051494 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.051460 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lsx9l\" (UID: \"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:16:00.053877 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.053855 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19b1d595-1b1a-4ecf-ad53-5b9d629a0d82-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lsx9l\" (UID: \"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:16:00.103223 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.103186 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" Jul 06 20:16:00.272015 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.271906 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d8b655f8-2tn4w"] Jul 06 20:16:00.274474 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:16:00.274445 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e6acf2_7687_406b_9147_c9ccbf58c7df.slice/crio-54ba9367ba2ff1968302c7ea5ea50d682235bfd476b44b5299893db64860453e WatchSource:0}: Error finding container 54ba9367ba2ff1968302c7ea5ea50d682235bfd476b44b5299893db64860453e: Status 404 returned error can't find the container with id 54ba9367ba2ff1968302c7ea5ea50d682235bfd476b44b5299893db64860453e Jul 06 20:16:00.291838 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.291815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:16:00.434503 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.434418 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l"] Jul 06 20:16:00.656244 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.656210 2559 generic.go:356] "Generic (PLEG): container finished" podID="366cfd01-b0af-4949-9966-f67b1b08f962" containerID="2dfa3154ac363cbb365d3b45db647a0ff9f9cc0df7d6b1c80aa22805f1623bd2" exitCode=0 Jul 06 20:16:00.656450 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.656295 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"366cfd01-b0af-4949-9966-f67b1b08f962","Type":"ContainerDied","Data":"2dfa3154ac363cbb365d3b45db647a0ff9f9cc0df7d6b1c80aa22805f1623bd2"} Jul 06 20:16:00.658279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.658255 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9727583-c3b6-4db4-a6c0-8d160972780e" containerID="3193f0ff0abd7c7f03cb97db62576e5123822d02ec016295db9fabbe692ddcb3" exitCode=0 Jul 06 20:16:00.658402 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.658329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45p4r" event={"ID":"c9727583-c3b6-4db4-a6c0-8d160972780e","Type":"ContainerDied","Data":"3193f0ff0abd7c7f03cb97db62576e5123822d02ec016295db9fabbe692ddcb3"} Jul 06 20:16:00.660341 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.660309 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" event={"ID":"24e6acf2-7687-406b-9147-c9ccbf58c7df","Type":"ContainerStarted","Data":"54ba9367ba2ff1968302c7ea5ea50d682235bfd476b44b5299893db64860453e"} Jul 06 20:16:00.805326 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.805240 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:16:00.842246 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.842213 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:16:00.842416 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.842392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.845903 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.845871 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:16:00.846339 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.846313 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:16:00.846339 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.846323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:16:00.846547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.846353 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:16:00.846547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.846377 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:16:00.846547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.846435 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:16:00.846547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.846439 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:16:00.846547 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.846470 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:16:00.846888 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.846872 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:16:00.847728 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.847706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lrrds\"" Jul 06 20:16:00.847863 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.847754 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:16:00.847863 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.847706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bafbhc0dlhfm7\"" Jul 06 20:16:00.847989 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.847939 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:16:00.848905 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.848881 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:16:00.864646 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.864624 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:16:00.865348 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.865322 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:16:00.870406 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.868117 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:16:00.966529 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966529 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966711 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966711 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966711 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966711 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvpbb\" (UniqueName: \"kubernetes.io/projected/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-kube-api-access-mvpbb\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.966934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966915 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-config\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.967488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.966992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.967488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.967021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.967488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:00.967046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:00.985360 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:16:00.985336 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b1d595_1b1a_4ecf_ad53_5b9d629a0d82.slice/crio-941dce07dac3e6fe28578d2540faaf9bbaf7025dea080591df71c1c64b806dcd WatchSource:0}: Error finding container 941dce07dac3e6fe28578d2540faaf9bbaf7025dea080591df71c1c64b806dcd: Status 404 returned error can't find the container with id 941dce07dac3e6fe28578d2540faaf9bbaf7025dea080591df71c1c64b806dcd Jul 06 20:16:01.068445 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068591 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068452 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068591 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068468 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068591 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068493 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068591 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068591 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068591 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068889 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-config\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068889 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068889 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068889 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068889 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068889 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068889 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.068889 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.069500 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068907 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.069500 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.069500 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.068975 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.069500 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.069015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvpbb\" (UniqueName: \"kubernetes.io/projected/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-kube-api-access-mvpbb\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.069500 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.069042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.069500 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.069113 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.069852 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.069707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.070489 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.070200 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.072033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.072011 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-config\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.072266 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.072238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.073077 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.072357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.073077 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.073033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.073077 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.073041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.073286 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.073080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.073286 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.073099 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.073610 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.073544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.073818 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.073799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.074091 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.074067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.074191 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.074072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.074397 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.074380 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.074742 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.074706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.075210 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.075188 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.075600 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.075580 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.075918 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.075902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.091913 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.091891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvpbb\" (UniqueName: \"kubernetes.io/projected/3e25d3d5-6f8e-48f2-beb8-865194cbf3ef-kube-api-access-mvpbb\") pod \"prometheus-k8s-0\" (UID: \"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.167726 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.167695 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:01.498431 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.498301 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:16:01.505398 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:16:01.505368 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e25d3d5_6f8e_48f2_beb8_865194cbf3ef.slice/crio-9bdad3bc241a7c39d95011458a9587126ea84505dad883892693b59f6670009b WatchSource:0}: Error finding container 9bdad3bc241a7c39d95011458a9587126ea84505dad883892693b59f6670009b: Status 404 returned error can't find the container with id 9bdad3bc241a7c39d95011458a9587126ea84505dad883892693b59f6670009b Jul 06 20:16:01.668123 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.667926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" event={"ID":"6246649f-4bd9-4d06-a2fb-22ab49a23322","Type":"ContainerStarted","Data":"727f1af4d8c9abbd78ed6f1ac00df362e326ee0f34874dfe786da77ca96690a2"} Jul 06 20:16:01.668123 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.668018 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" event={"ID":"6246649f-4bd9-4d06-a2fb-22ab49a23322","Type":"ContainerStarted","Data":"e82218a9a34077da8ab537375f712bc214addee6bb06c0314f02bba4dc0d9814"} Jul 06 20:16:01.668123 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.668060 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" event={"ID":"6246649f-4bd9-4d06-a2fb-22ab49a23322","Type":"ContainerStarted","Data":"9d4ce4e16ddb553fdf0fff8afe29788458b23e2bcf208d618b7088caf5be0927"} Jul 06 20:16:01.670984 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.670532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45p4r" event={"ID":"c9727583-c3b6-4db4-a6c0-8d160972780e","Type":"ContainerStarted","Data":"09ffb7179f6b4de75a7eda71217cd66c93b0f4e2c7bd16f2dbee3f8e2dfbbb6b"} Jul 06 20:16:01.670984 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.670596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45p4r" event={"ID":"c9727583-c3b6-4db4-a6c0-8d160972780e","Type":"ContainerStarted","Data":"7bfec8edc0874989caa195f80fc048d9e79351fb5007819cc640e4ace7bd8c5d"} Jul 06 20:16:01.672385 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.672358 2559 generic.go:356] "Generic (PLEG): container finished" podID="3e25d3d5-6f8e-48f2-beb8-865194cbf3ef" containerID="c95bb970d05db05f30584ead0fb1f44a31f7e68c234c69b9921d50d979501a52" exitCode=0 Jul 06 20:16:01.672509 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.672425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef","Type":"ContainerDied","Data":"c95bb970d05db05f30584ead0fb1f44a31f7e68c234c69b9921d50d979501a52"} Jul 06 20:16:01.672509 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.672488 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef","Type":"ContainerStarted","Data":"9bdad3bc241a7c39d95011458a9587126ea84505dad883892693b59f6670009b"} Jul 06 20:16:01.675163 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.675078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" event={"ID":"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82","Type":"ContainerStarted","Data":"941dce07dac3e6fe28578d2540faaf9bbaf7025dea080591df71c1c64b806dcd"} Jul 06 20:16:01.694110 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:01.694055 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-45p4r" podStartSLOduration=6.259865351 podStartE2EDuration="7.694036257s" totalImagesPullingTime="1.361736834s" totalInitContainerRuntime="72.434072ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:01.692326821 +0000 UTC m=+74.025314709" watchObservedRunningTime="2026-07-06 20:16:01.694036257 +0000 UTC m=+74.027024108" Jul 06 20:16:04.697383 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.697342 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" event={"ID":"6246649f-4bd9-4d06-a2fb-22ab49a23322","Type":"ContainerStarted","Data":"c5fd4ae32464cedce3a7bd7c3f9c3d4397047ee62892e73b81448fecb5593200"} Jul 06 20:16:04.697890 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.697436 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" event={"ID":"6246649f-4bd9-4d06-a2fb-22ab49a23322","Type":"ContainerStarted","Data":"f83c7f41b8d9463a6e73242ab82c7eea93f5d605dfd23a7a956774c155a3b5e1"} Jul 06 20:16:04.697890 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.697483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" event={"ID":"6246649f-4bd9-4d06-a2fb-22ab49a23322","Type":"ContainerStarted","Data":"e21413828e94e78ff8dc330610555b414aa251df47c86f7f77362937c895186d"} Jul 06 20:16:04.697890 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.697527 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:16:04.701255 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.701229 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"366cfd01-b0af-4949-9966-f67b1b08f962","Type":"ContainerStarted","Data":"a2ead2be3ac080186939129b0f446df2c1631644616cbfdac95c5464edcac3c0"} Jul 06 20:16:04.701394 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.701297 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"366cfd01-b0af-4949-9966-f67b1b08f962","Type":"ContainerStarted","Data":"bb26f35385fc868e7f7c0243065dbc73a7432539619eb35bf0571c91e05532ee"} Jul 06 20:16:04.701394 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.701346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"366cfd01-b0af-4949-9966-f67b1b08f962","Type":"ContainerStarted","Data":"8a41629de2c1f022b66bdc831ca785d8218c4eea7b18927e0643d7789f24674e"} Jul 06 20:16:04.701394 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.701386 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"366cfd01-b0af-4949-9966-f67b1b08f962","Type":"ContainerStarted","Data":"0d0b486eef2046e11e99a679cad5618074a99bf15e6a41105316f42907385960"} Jul 06 20:16:04.701586 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.701424 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"366cfd01-b0af-4949-9966-f67b1b08f962","Type":"ContainerStarted","Data":"eeb1ccd1d29b3e7cabed87bf2b9cc1ead624cea38bc0a141e3c16ac0825c1e8f"} Jul 06 20:16:04.701586 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.701463 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"366cfd01-b0af-4949-9966-f67b1b08f962","Type":"ContainerStarted","Data":"4d0456d1884f30665bc8af6f5067962ab64b6f4ac0256c36dad845704e8285ef"} Jul 06 20:16:04.703624 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.703593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" event={"ID":"24e6acf2-7687-406b-9147-c9ccbf58c7df","Type":"ContainerStarted","Data":"3b223540fc21d476ca679806c32cb5909ce4862bd96bc84d03664c0032c5a73d"} Jul 06 20:16:04.703753 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.703649 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" event={"ID":"24e6acf2-7687-406b-9147-c9ccbf58c7df","Type":"ContainerStarted","Data":"c8424053c7574f0366c8364bff8375209761459d455be8809f97b970da994fdd"} Jul 06 20:16:04.703753 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.703682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" event={"ID":"24e6acf2-7687-406b-9147-c9ccbf58c7df","Type":"ContainerStarted","Data":"e3fb78ed595e55d352d4ead768d980f15e9497192628fc42cbca9a12beeccf74"} Jul 06 20:16:04.705289 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.705260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" event={"ID":"19b1d595-1b1a-4ecf-ad53-5b9d629a0d82","Type":"ContainerStarted","Data":"3574957abb62356262a206ba79a38c50757ed10987b6a216b134b174de3586d1"} Jul 06 20:16:04.705491 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.705471 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:16:04.711220 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.711202 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" Jul 06 20:16:04.725085 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.725045 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" podStartSLOduration=3.5499582370000002 podStartE2EDuration="8.72503192s" totalImagesPullingTime="5.175073683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:04.722380274 +0000 UTC m=+77.055368136" watchObservedRunningTime="2026-07-06 20:16:04.72503192 +0000 UTC m=+77.058019777" Jul 06 20:16:04.738978 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.738943 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsx9l" podStartSLOduration=3.097969643 podStartE2EDuration="5.738930826s" totalImagesPullingTime="2.640961183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:04.738088471 +0000 UTC m=+77.071076329" watchObservedRunningTime="2026-07-06 20:16:04.738930826 +0000 UTC m=+77.071918716" Jul 06 20:16:04.768781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.768732 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d8b655f8-2tn4w" podStartSLOduration=2.362899174 podStartE2EDuration="5.768712417s" totalImagesPullingTime="3.405813243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:04.768059011 +0000 UTC m=+77.101046891" watchObservedRunningTime="2026-07-06 20:16:04.768712417 +0000 UTC m=+77.101700276" Jul 06 20:16:04.795712 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:04.795659 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.177673239 podStartE2EDuration="9.795645306s" totalImagesPullingTime="4.584677767s" totalInitContainerRuntime="33.2943ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:04.794808974 +0000 UTC m=+77.127796833" watchObservedRunningTime="2026-07-06 20:16:04.795645306 +0000 UTC m=+77.128633168" Jul 06 20:16:05.715510 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:05.715477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef","Type":"ContainerStarted","Data":"920d9083d4495647a8d4285cb6ff4a9d530ab3d1dd2ec3238a5356b2ef09f9e1"} Jul 06 20:16:05.715895 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:05.715606 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef","Type":"ContainerStarted","Data":"9be8205338a9eb7977acfeb1886a37ff39b1537d0f3edb8ec193905a05c24c94"} Jul 06 20:16:05.715895 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:05.715650 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef","Type":"ContainerStarted","Data":"a9d6dcded8db435f84e08b7a193893d5bd536153451e582adb297ed79c4a6e03"} Jul 06 20:16:05.715895 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:05.715687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef","Type":"ContainerStarted","Data":"c852f9267fe732fb2dacdbf6fd55e7701d65de589636f1724da4e21371c49dce"} Jul 06 20:16:06.722830 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:06.722788 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef","Type":"ContainerStarted","Data":"48ffa55307ea5da847222898edaae3832e26ab5abba18dd9a278a7349882e197"} Jul 06 20:16:06.723296 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:06.722871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e25d3d5-6f8e-48f2-beb8-865194cbf3ef","Type":"ContainerStarted","Data":"07159773b7add9dc4bb39c819f9f579ae319c5ad21aeed0f04485dffd24f8002"} Jul 06 20:16:06.758003 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:06.757935 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.055670275 podStartE2EDuration="6.757919149s" totalImagesPullingTime="3.67304242s" totalInitContainerRuntime="29.206454ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:06.755249885 +0000 UTC m=+79.088237746" watchObservedRunningTime="2026-07-06 20:16:06.757919149 +0000 UTC m=+79.090907006" Jul 06 20:16:10.722596 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:10.722453 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-854d5677b8-qsqcd" Jul 06 20:16:11.168414 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:11.168378 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:16:29.652908 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:16:29.652875 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8lgdr" Jul 06 20:17:01.168731 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:17:01.168671 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:17:01.190109 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:17:01.190078 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:17:01.960872 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:17:01.960841 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:19:04.895089 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:04.895050 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9"] Jul 06 20:19:04.897596 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:04.897578 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" Jul 06 20:19:04.900328 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:04.900303 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:19:04.901570 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:04.901534 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rgc9c\"" Jul 06 20:19:04.901690 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:04.901575 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 20:19:04.906812 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:04.906780 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9"] Jul 06 20:19:05.039898 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.039864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhrt6\" (UniqueName: \"kubernetes.io/projected/61bc56c7-b03a-4b16-9eda-812661e390ca-kube-api-access-zhrt6\") pod \"openshift-lws-operator-fd8ccff4c-qd9p9\" (UID: \"61bc56c7-b03a-4b16-9eda-812661e390ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" Jul 06 20:19:05.040104 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.039931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61bc56c7-b03a-4b16-9eda-812661e390ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qd9p9\" (UID: \"61bc56c7-b03a-4b16-9eda-812661e390ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" Jul 06 20:19:05.141025 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.140975 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhrt6\" (UniqueName: \"kubernetes.io/projected/61bc56c7-b03a-4b16-9eda-812661e390ca-kube-api-access-zhrt6\") pod \"openshift-lws-operator-fd8ccff4c-qd9p9\" (UID: \"61bc56c7-b03a-4b16-9eda-812661e390ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" Jul 06 20:19:05.141217 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.141043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61bc56c7-b03a-4b16-9eda-812661e390ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qd9p9\" (UID: \"61bc56c7-b03a-4b16-9eda-812661e390ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" Jul 06 20:19:05.141452 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.141434 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61bc56c7-b03a-4b16-9eda-812661e390ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qd9p9\" (UID: \"61bc56c7-b03a-4b16-9eda-812661e390ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" Jul 06 20:19:05.151027 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.150948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhrt6\" (UniqueName: \"kubernetes.io/projected/61bc56c7-b03a-4b16-9eda-812661e390ca-kube-api-access-zhrt6\") pod \"openshift-lws-operator-fd8ccff4c-qd9p9\" (UID: \"61bc56c7-b03a-4b16-9eda-812661e390ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" Jul 06 20:19:05.216384 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.216337 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" Jul 06 20:19:05.346677 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.346652 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9"] Jul 06 20:19:05.349408 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:19:05.349384 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61bc56c7_b03a_4b16_9eda_812661e390ca.slice/crio-120c55663672e616477009be81ccce04710f1133130c5035c5dc331f1e8c586b WatchSource:0}: Error finding container 120c55663672e616477009be81ccce04710f1133130c5035c5dc331f1e8c586b: Status 404 returned error can't find the container with id 120c55663672e616477009be81ccce04710f1133130c5035c5dc331f1e8c586b Jul 06 20:19:05.402140 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:05.402049 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" event={"ID":"61bc56c7-b03a-4b16-9eda-812661e390ca","Type":"ContainerStarted","Data":"120c55663672e616477009be81ccce04710f1133130c5035c5dc331f1e8c586b"} Jul 06 20:19:09.421091 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:09.421053 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" event={"ID":"61bc56c7-b03a-4b16-9eda-812661e390ca","Type":"ContainerStarted","Data":"4e2c4c65b514799ca8955d9ba7d981eb3d388399b7d219b76bbacbaa94c1eec3"} Jul 06 20:19:09.439314 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:09.439260 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd9p9" podStartSLOduration=2.367290289 podStartE2EDuration="5.439244897s" totalImagesPullingTime="3.071954608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:09.437612261 +0000 UTC m=+261.770600139" watchObservedRunningTime="2026-07-06 20:19:09.439244897 +0000 UTC m=+261.772232754" Jul 06 20:19:25.132045 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.131953 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq"] Jul 06 20:19:25.136511 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.136486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.140632 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.140602 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 20:19:25.140840 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.140687 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 20:19:25.140840 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.140690 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 20:19:25.141069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.141037 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 20:19:25.144301 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.144279 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-88kxf\"" Jul 06 20:19:25.158075 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.158048 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq"] Jul 06 20:19:25.317012 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.316953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cb7994e-e443-4b21-9d64-bb8a059415d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.317223 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.317030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cb7994e-e443-4b21-9d64-bb8a059415d4-tmp\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.317223 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.317120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cb7994e-e443-4b21-9d64-bb8a059415d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.317223 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.317147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cb7994e-e443-4b21-9d64-bb8a059415d4-manifests\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.317223 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.317165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8p7d\" (UniqueName: \"kubernetes.io/projected/6cb7994e-e443-4b21-9d64-bb8a059415d4-kube-api-access-w8p7d\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.417938 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.417886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cb7994e-e443-4b21-9d64-bb8a059415d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.418158 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.417958 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cb7994e-e443-4b21-9d64-bb8a059415d4-tmp\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.418158 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.418039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cb7994e-e443-4b21-9d64-bb8a059415d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.418158 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.418067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cb7994e-e443-4b21-9d64-bb8a059415d4-manifests\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.418158 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.418092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8p7d\" (UniqueName: \"kubernetes.io/projected/6cb7994e-e443-4b21-9d64-bb8a059415d4-kube-api-access-w8p7d\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.418553 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.418517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cb7994e-e443-4b21-9d64-bb8a059415d4-manifests\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.420398 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.420369 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cb7994e-e443-4b21-9d64-bb8a059415d4-tmp\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.420700 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.420683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cb7994e-e443-4b21-9d64-bb8a059415d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.420752 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.420720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cb7994e-e443-4b21-9d64-bb8a059415d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.428955 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.428928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8p7d\" (UniqueName: \"kubernetes.io/projected/6cb7994e-e443-4b21-9d64-bb8a059415d4-kube-api-access-w8p7d\") pod \"opendatahub-operator-controller-manager-9b6b7b7bb-zptlq\" (UID: \"6cb7994e-e443-4b21-9d64-bb8a059415d4\") " pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.447753 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.447710 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:25.600521 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:25.600491 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq"] Jul 06 20:19:25.603454 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:19:25.603417 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb7994e_e443_4b21_9d64_bb8a059415d4.slice/crio-7dd583b81f66e139dc4e9f3ec2fdacb82e4143a3350b4abc5844d7be40c1ba34 WatchSource:0}: Error finding container 7dd583b81f66e139dc4e9f3ec2fdacb82e4143a3350b4abc5844d7be40c1ba34: Status 404 returned error can't find the container with id 7dd583b81f66e139dc4e9f3ec2fdacb82e4143a3350b4abc5844d7be40c1ba34 Jul 06 20:19:26.493725 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:26.493662 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" event={"ID":"6cb7994e-e443-4b21-9d64-bb8a059415d4","Type":"ContainerStarted","Data":"7dd583b81f66e139dc4e9f3ec2fdacb82e4143a3350b4abc5844d7be40c1ba34"} Jul 06 20:19:29.510536 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:29.510497 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" event={"ID":"6cb7994e-e443-4b21-9d64-bb8a059415d4","Type":"ContainerStarted","Data":"169af732acbfefbacf88492cf38fa3c5310121735504af3ed20c86eb0775f7b0"} Jul 06 20:19:30.517858 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:30.517801 2559 generic.go:356] "Generic (PLEG): container finished" podID="6cb7994e-e443-4b21-9d64-bb8a059415d4" containerID="169af732acbfefbacf88492cf38fa3c5310121735504af3ed20c86eb0775f7b0" exitCode=0 Jul 06 20:19:30.518412 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:30.517881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" event={"ID":"6cb7994e-e443-4b21-9d64-bb8a059415d4","Type":"ContainerDied","Data":"169af732acbfefbacf88492cf38fa3c5310121735504af3ed20c86eb0775f7b0"} Jul 06 20:19:31.524729 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:31.524692 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" event={"ID":"6cb7994e-e443-4b21-9d64-bb8a059415d4","Type":"ContainerStarted","Data":"bee560292b86f7ad7d9f705f57b9f5317ae6cb8158ece512c66ad253e14e43aa"} Jul 06 20:19:31.525166 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:31.524795 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:31.548414 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:31.548359 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" podStartSLOduration=1.803631255 podStartE2EDuration="6.548342905s" totalImagesPullingTime="3.575616781s" totalInitContainerRuntime="1.169094869s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:31.546514892 +0000 UTC m=+283.879502751" watchObservedRunningTime="2026-07-06 20:19:31.548342905 +0000 UTC m=+283.881330763" Jul 06 20:19:42.531496 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:42.531464 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9b6b7b7bb-zptlq" Jul 06 20:19:44.935922 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.935881 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7"] Jul 06 20:19:44.939342 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.939323 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:44.942998 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.942976 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 20:19:44.943164 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.942977 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 20:19:44.944056 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.944040 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bfbrj\"" Jul 06 20:19:44.944168 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.944125 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 20:19:44.944481 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.944466 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 20:19:44.957323 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.957298 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7"] Jul 06 20:19:44.997931 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.997896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f22ca5-3cea-411d-b593-ce87e7f45291-tls-certs\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:44.998128 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.997940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f22ca5-3cea-411d-b593-ce87e7f45291-tmp\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:44.998128 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:44.997989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm6f6\" (UniqueName: \"kubernetes.io/projected/d2f22ca5-3cea-411d-b593-ce87e7f45291-kube-api-access-gm6f6\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:45.099495 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.099463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f22ca5-3cea-411d-b593-ce87e7f45291-tls-certs\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:45.099720 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.099506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f22ca5-3cea-411d-b593-ce87e7f45291-tmp\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:45.099720 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.099539 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm6f6\" (UniqueName: \"kubernetes.io/projected/d2f22ca5-3cea-411d-b593-ce87e7f45291-kube-api-access-gm6f6\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:45.102021 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.101991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f22ca5-3cea-411d-b593-ce87e7f45291-tmp\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:45.102338 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.102316 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f22ca5-3cea-411d-b593-ce87e7f45291-tls-certs\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:45.111074 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.111050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm6f6\" (UniqueName: \"kubernetes.io/projected/d2f22ca5-3cea-411d-b593-ce87e7f45291-kube-api-access-gm6f6\") pod \"kube-auth-proxy-7f9c87b66f-4mpw7\" (UID: \"d2f22ca5-3cea-411d-b593-ce87e7f45291\") " pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:45.248491 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.248404 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" Jul 06 20:19:45.397719 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.397680 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7"] Jul 06 20:19:45.401785 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:19:45.401757 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f22ca5_3cea_411d_b593_ce87e7f45291.slice/crio-570fcf7048f4c962c47ed9922e2146d94b13e242dd34c2b1a21288f4d6f547c0 WatchSource:0}: Error finding container 570fcf7048f4c962c47ed9922e2146d94b13e242dd34c2b1a21288f4d6f547c0: Status 404 returned error can't find the container with id 570fcf7048f4c962c47ed9922e2146d94b13e242dd34c2b1a21288f4d6f547c0 Jul 06 20:19:45.590216 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:45.590126 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" event={"ID":"d2f22ca5-3cea-411d-b593-ce87e7f45291","Type":"ContainerStarted","Data":"570fcf7048f4c962c47ed9922e2146d94b13e242dd34c2b1a21288f4d6f547c0"} Jul 06 20:19:48.612077 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:48.612042 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 20:19:48.636305 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:48.636275 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 20:19:49.610294 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:49.610259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" event={"ID":"d2f22ca5-3cea-411d-b593-ce87e7f45291","Type":"ContainerStarted","Data":"e4031db005df1e32da4eca3d1144ffb6c0ea5977a941dfd0bf7aca9c36a13f9a"} Jul 06 20:19:49.630533 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:49.630475 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f9c87b66f-4mpw7" podStartSLOduration=2.400996532 podStartE2EDuration="5.630457248s" totalImagesPullingTime="3.229460716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:49.62968384 +0000 UTC m=+301.962671732" watchObservedRunningTime="2026-07-06 20:19:49.630457248 +0000 UTC m=+301.963445106" Jul 06 20:19:52.304887 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.304848 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744"] Jul 06 20:19:52.308222 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.308205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.312276 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.312255 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 20:19:52.312447 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.312260 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 20:19:52.312447 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.312384 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j5z9h\"" Jul 06 20:19:52.313835 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.313814 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 20:19:52.317422 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.317403 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 20:19:52.328943 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.328920 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744"] Jul 06 20:19:52.465143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.465107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.465357 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.465156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.465357 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.465188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.465357 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.465213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.465357 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.465230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.465357 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.465316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.465616 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.465366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wgcz\" (UniqueName: \"kubernetes.io/projected/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-kube-api-access-9wgcz\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.566612 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.566489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.566612 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.566531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.566850 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.566671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.566850 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.566727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.566850 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.566750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.567004 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.566918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.567058 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.567018 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wgcz\" (UniqueName: \"kubernetes.io/projected/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-kube-api-access-9wgcz\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.567376 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.567325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.569045 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.569026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.569282 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.569261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.569441 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.569423 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.569527 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.569508 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.575974 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.575952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wgcz\" (UniqueName: \"kubernetes.io/projected/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-kube-api-access-9wgcz\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.576121 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.576105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61d846f-6ce4-49fe-a08c-1d9a1d0b861d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gz744\" (UID: \"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.617900 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.617858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:52.757553 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.757520 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744"] Jul 06 20:19:52.760399 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:19:52.760358 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61d846f_6ce4_49fe_a08c_1d9a1d0b861d.slice/crio-408d263482e1ec15358de5fcd79272d511eb109a652fe20bde22f73c10bc2834 WatchSource:0}: Error finding container 408d263482e1ec15358de5fcd79272d511eb109a652fe20bde22f73c10bc2834: Status 404 returned error can't find the container with id 408d263482e1ec15358de5fcd79272d511eb109a652fe20bde22f73c10bc2834 Jul 06 20:19:52.763243 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:52.763222 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:19:53.536121 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.536083 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst"] Jul 06 20:19:53.541756 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.541732 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.547029 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.546778 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 20:19:53.547029 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.546806 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 20:19:53.547029 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.546901 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 20:19:53.547029 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.546968 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f4gw6\"" Jul 06 20:19:53.556932 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.556891 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst"] Jul 06 20:19:53.632470 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.632433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" event={"ID":"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d","Type":"ContainerStarted","Data":"408d263482e1ec15358de5fcd79272d511eb109a652fe20bde22f73c10bc2834"} Jul 06 20:19:53.677999 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.677962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9fa96fd-32fa-423f-9532-48cc901a5ab2-cert\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.678217 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.678092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktsjq\" (UniqueName: \"kubernetes.io/projected/f9fa96fd-32fa-423f-9532-48cc901a5ab2-kube-api-access-ktsjq\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.678217 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.678133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f9fa96fd-32fa-423f-9532-48cc901a5ab2-manager-config\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.678217 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.678164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9fa96fd-32fa-423f-9532-48cc901a5ab2-metrics-cert\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.778624 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.778587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktsjq\" (UniqueName: \"kubernetes.io/projected/f9fa96fd-32fa-423f-9532-48cc901a5ab2-kube-api-access-ktsjq\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.778807 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.778634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f9fa96fd-32fa-423f-9532-48cc901a5ab2-manager-config\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.778807 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.778692 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9fa96fd-32fa-423f-9532-48cc901a5ab2-metrics-cert\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.778807 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.778769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9fa96fd-32fa-423f-9532-48cc901a5ab2-cert\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.779343 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.779313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f9fa96fd-32fa-423f-9532-48cc901a5ab2-manager-config\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.781425 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.781398 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9fa96fd-32fa-423f-9532-48cc901a5ab2-metrics-cert\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.781541 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.781471 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9fa96fd-32fa-423f-9532-48cc901a5ab2-cert\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.796807 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.796735 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktsjq\" (UniqueName: \"kubernetes.io/projected/f9fa96fd-32fa-423f-9532-48cc901a5ab2-kube-api-access-ktsjq\") pod \"lws-controller-manager-86b486bf74-x5nst\" (UID: \"f9fa96fd-32fa-423f-9532-48cc901a5ab2\") " pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:53.853781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:53.853737 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:54.006287 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:54.006261 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst"] Jul 06 20:19:54.008328 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:19:54.008298 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fa96fd_32fa_423f_9532_48cc901a5ab2.slice/crio-b52cec058b5528126eb18b7c838a3d6d9497611b3ae5c2892d0221258d135159 WatchSource:0}: Error finding container b52cec058b5528126eb18b7c838a3d6d9497611b3ae5c2892d0221258d135159: Status 404 returned error can't find the container with id b52cec058b5528126eb18b7c838a3d6d9497611b3ae5c2892d0221258d135159 Jul 06 20:19:54.638845 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:54.638802 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" event={"ID":"f9fa96fd-32fa-423f-9532-48cc901a5ab2","Type":"ContainerStarted","Data":"b52cec058b5528126eb18b7c838a3d6d9497611b3ae5c2892d0221258d135159"} Jul 06 20:19:55.645867 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:55.645753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" event={"ID":"f9fa96fd-32fa-423f-9532-48cc901a5ab2","Type":"ContainerStarted","Data":"f42f3715b816b01f64a4a9668ce14fce3c58d49a789808c96aaa9d55b4117c0f"} Jul 06 20:19:55.645867 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:55.645831 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:19:56.786923 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:56.786884 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 06 20:19:56.787241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:56.786960 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 06 20:19:57.657829 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:57.657789 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" event={"ID":"a61d846f-6ce4-49fe-a08c-1d9a1d0b861d","Type":"ContainerStarted","Data":"3e47a9a7e89b07ec3197747d4607fb0d76f41f15d8d7f685bb36aa74153e7944"} Jul 06 20:19:57.658035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:57.657875 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:57.659842 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:57.659817 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" Jul 06 20:19:57.690354 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:57.689741 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gz744" podStartSLOduration=1.666519901 podStartE2EDuration="5.689718897s" totalImagesPullingTime="4.023198996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:57.686856043 +0000 UTC m=+310.019843902" watchObservedRunningTime="2026-07-06 20:19:57.689718897 +0000 UTC m=+310.022706757" Jul 06 20:19:57.691250 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:19:57.691211 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" podStartSLOduration=3.253337059 podStartE2EDuration="4.691196472s" totalImagesPullingTime="1.437859413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:55.706453298 +0000 UTC m=+308.039441156" watchObservedRunningTime="2026-07-06 20:19:57.691196472 +0000 UTC m=+310.024184329" Jul 06 20:20:06.654034 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:20:06.653996 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86b486bf74-x5nst" Jul 06 20:24:31.334977 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.334938 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj"] Jul 06 20:24:31.338284 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.338264 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.341181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.341155 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sf5s6\"" Jul 06 20:24:31.341181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.341172 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 20:24:31.342497 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.342465 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 20:24:31.342624 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.342582 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 20:24:31.351792 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.351768 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj"] Jul 06 20:24:31.486995 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.486953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3d4d9e7-900b-440b-9217-823f94b86d71-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.486995 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.486994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.487318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.487063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.487318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.487148 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.487318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.487177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgh2r\" (UniqueName: \"kubernetes.io/projected/b3d4d9e7-900b-440b-9217-823f94b86d71-kube-api-access-sgh2r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.487318 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.487252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588105 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3d4d9e7-900b-440b-9217-823f94b86d71-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588105 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588105 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588074 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588355 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588355 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgh2r\" (UniqueName: \"kubernetes.io/projected/b3d4d9e7-900b-440b-9217-823f94b86d71-kube-api-access-sgh2r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588355 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588532 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588505 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588632 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.588707 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.588681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.590499 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.590471 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3d4d9e7-900b-440b-9217-823f94b86d71-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.590853 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.590827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3d4d9e7-900b-440b-9217-823f94b86d71-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.597634 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.597608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgh2r\" (UniqueName: \"kubernetes.io/projected/b3d4d9e7-900b-440b-9217-823f94b86d71-kube-api-access-sgh2r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fzvqj\" (UID: \"b3d4d9e7-900b-440b-9217-823f94b86d71\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.650251 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.650219 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:31.798505 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.798479 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj"] Jul 06 20:24:31.801440 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:24:31.801408 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d4d9e7_900b_440b_9217_823f94b86d71.slice/crio-4921e9ad6ac796a826df732769cd579caea2cee65c64cfdd01c594f7e2f93799 WatchSource:0}: Error finding container 4921e9ad6ac796a826df732769cd579caea2cee65c64cfdd01c594f7e2f93799: Status 404 returned error can't find the container with id 4921e9ad6ac796a826df732769cd579caea2cee65c64cfdd01c594f7e2f93799 Jul 06 20:24:31.899451 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:31.899356 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" event={"ID":"b3d4d9e7-900b-440b-9217-823f94b86d71","Type":"ContainerStarted","Data":"4921e9ad6ac796a826df732769cd579caea2cee65c64cfdd01c594f7e2f93799"} Jul 06 20:24:33.910130 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:33.910096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" event={"ID":"b3d4d9e7-900b-440b-9217-823f94b86d71","Type":"ContainerStarted","Data":"c63ea5c3629adc921569c8819a08ad6233c2fdb8bcd7cf7f5af1a1e7c8bc4a42"} Jul 06 20:24:33.930293 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:33.930238 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" podStartSLOduration=1.7930159140000002 podStartE2EDuration="2.930219059s" totalImagesPullingTime="1.137203145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:33.928488642 +0000 UTC m=+586.261476512" watchObservedRunningTime="2026-07-06 20:24:33.930219059 +0000 UTC m=+586.263206917" Jul 06 20:24:41.651336 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:41.651292 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:41.651786 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:41.651392 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:41.664203 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:41.664175 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:24:41.956277 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:24:41.956241 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fzvqj" Jul 06 20:43:28.730404 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.730349 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h"] Jul 06 20:43:28.732782 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.732764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:28.744616 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.744587 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bd79a608\"/\"openshift-service-ca.crt\"" Jul 06 20:43:28.744871 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.744853 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bd79a608\"/\"e2e-lifecycle-model-bd79a608-kserve-self-signed-certs\"" Jul 06 20:43:28.744950 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.744931 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bd79a608\"/\"kube-root-ca.crt\"" Jul 06 20:43:28.744991 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.744938 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bd79a608\"/\"default-dockercfg-d4fb7\"" Jul 06 20:43:28.769396 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.769361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h"] Jul 06 20:43:28.905502 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.905466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-dshm\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:28.905502 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.905508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-home\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:28.905762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.905612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmd29\" (UniqueName: \"kubernetes.io/projected/6a2ae720-9576-413b-83da-0cb2c5d84f41-kube-api-access-fmd29\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:28.905762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.905684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-model-cache\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:28.905762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.905711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2ae720-9576-413b-83da-0cb2c5d84f41-tls-certs\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:28.905894 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:28.905778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-tmp-dir\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.006762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.006526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmd29\" (UniqueName: \"kubernetes.io/projected/6a2ae720-9576-413b-83da-0cb2c5d84f41-kube-api-access-fmd29\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.006762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.006701 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-model-cache\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.006762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.006743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2ae720-9576-413b-83da-0cb2c5d84f41-tls-certs\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.006762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.006777 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-tmp-dir\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.007202 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.006804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-dshm\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.007202 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.006834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-home\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.007375 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.007339 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-model-cache\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.007413 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.007342 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-tmp-dir\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.007450 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.007419 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-home\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.009661 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.009634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-dshm\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.009823 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.009803 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2ae720-9576-413b-83da-0cb2c5d84f41-tls-certs\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.026122 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.026055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmd29\" (UniqueName: \"kubernetes.io/projected/6a2ae720-9576-413b-83da-0cb2c5d84f41-kube-api-access-fmd29\") pod \"e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.042787 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.042750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:29.190027 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:29.189984 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h"] Jul 06 20:43:29.192966 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:43:29.192939 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a2ae720_9576_413b_83da_0cb2c5d84f41.slice/crio-e7596dcbdbcb8c8f293e42d425fc4e7a9b5706b4a8237aa023260232cee93f91 WatchSource:0}: Error finding container e7596dcbdbcb8c8f293e42d425fc4e7a9b5706b4a8237aa023260232cee93f91: Status 404 returned error can't find the container with id e7596dcbdbcb8c8f293e42d425fc4e7a9b5706b4a8237aa023260232cee93f91 Jul 06 20:43:30.054171 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:30.054135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" event={"ID":"6a2ae720-9576-413b-83da-0cb2c5d84f41","Type":"ContainerStarted","Data":"bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82"} Jul 06 20:43:30.054171 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:30.054178 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" event={"ID":"6a2ae720-9576-413b-83da-0cb2c5d84f41","Type":"ContainerStarted","Data":"e7596dcbdbcb8c8f293e42d425fc4e7a9b5706b4a8237aa023260232cee93f91"} Jul 06 20:43:30.082905 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:30.082848 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" podStartSLOduration=2.082831085 podStartE2EDuration="2.082831085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:30.081343687 +0000 UTC m=+1722.414331544" watchObservedRunningTime="2026-07-06 20:43:30.082831085 +0000 UTC m=+1722.415818944" Jul 06 20:43:39.043064 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:39.043011 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:39.043064 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:39.043070 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:39.055884 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:39.055857 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:43:39.112072 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:43:39.112033 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:44:13.049073 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:13.049025 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h"] Jul 06 20:44:28.069949 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.069897 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" podUID="6a2ae720-9576-413b-83da-0cb2c5d84f41" containerName="main" containerID="cri-o://bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82" gracePeriod=45 Jul 06 20:44:28.317836 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.317797 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:44:28.318477 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.318455 2559 generic.go:356] "Generic (PLEG): container finished" podID="6a2ae720-9576-413b-83da-0cb2c5d84f41" containerID="bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82" exitCode=0 Jul 06 20:44:28.318542 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.318506 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" event={"ID":"6a2ae720-9576-413b-83da-0cb2c5d84f41","Type":"ContainerDied","Data":"bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82"} Jul 06 20:44:28.318542 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.318537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" event={"ID":"6a2ae720-9576-413b-83da-0cb2c5d84f41","Type":"ContainerDied","Data":"e7596dcbdbcb8c8f293e42d425fc4e7a9b5706b4a8237aa023260232cee93f91"} Jul 06 20:44:28.318643 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.318588 2559 scope.go:117] "RemoveContainer" containerID="bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82" Jul 06 20:44:28.327162 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.327145 2559 scope.go:117] "RemoveContainer" containerID="bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82" Jul 06 20:44:28.327433 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:44:28.327411 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82\": container with ID starting with bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82 not found: ID does not exist" containerID="bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82" Jul 06 20:44:28.327496 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.327445 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82"} err="failed to get container status \"bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82\": rpc error: code = NotFound desc = could not find container \"bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82\": container with ID starting with bf3242951eff87d6b4c9a0ece907ab153a86665b8af3d522756ce3c9c3de5c82 not found: ID does not exist" Jul 06 20:44:28.362505 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.362466 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-tmp-dir\") pod \"6a2ae720-9576-413b-83da-0cb2c5d84f41\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " Jul 06 20:44:28.362734 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.362532 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-dshm\") pod \"6a2ae720-9576-413b-83da-0cb2c5d84f41\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " Jul 06 20:44:28.362817 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.362744 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-home\") pod \"6a2ae720-9576-413b-83da-0cb2c5d84f41\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " Jul 06 20:44:28.362817 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.362793 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmd29\" (UniqueName: \"kubernetes.io/projected/6a2ae720-9576-413b-83da-0cb2c5d84f41-kube-api-access-fmd29\") pod \"6a2ae720-9576-413b-83da-0cb2c5d84f41\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " Jul 06 20:44:28.362923 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.362861 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2ae720-9576-413b-83da-0cb2c5d84f41-tls-certs\") pod \"6a2ae720-9576-413b-83da-0cb2c5d84f41\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " Jul 06 20:44:28.362923 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.362908 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-model-cache\") pod \"6a2ae720-9576-413b-83da-0cb2c5d84f41\" (UID: \"6a2ae720-9576-413b-83da-0cb2c5d84f41\") " Jul 06 20:44:28.363023 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.362934 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a2ae720-9576-413b-83da-0cb2c5d84f41" (UID: "6a2ae720-9576-413b-83da-0cb2c5d84f41"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:44:28.363255 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.363225 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-tmp-dir\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:44:28.363469 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.363438 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a2ae720-9576-413b-83da-0cb2c5d84f41" (UID: "6a2ae720-9576-413b-83da-0cb2c5d84f41"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:44:28.364019 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.363987 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-home" (OuterVolumeSpecName: "home") pod "6a2ae720-9576-413b-83da-0cb2c5d84f41" (UID: "6a2ae720-9576-413b-83da-0cb2c5d84f41"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:44:28.365985 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.365526 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a2ae720-9576-413b-83da-0cb2c5d84f41-kube-api-access-fmd29" (OuterVolumeSpecName: "kube-api-access-fmd29") pod "6a2ae720-9576-413b-83da-0cb2c5d84f41" (UID: "6a2ae720-9576-413b-83da-0cb2c5d84f41"). InnerVolumeSpecName "kube-api-access-fmd29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:44:28.365985 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.365778 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-dshm" (OuterVolumeSpecName: "dshm") pod "6a2ae720-9576-413b-83da-0cb2c5d84f41" (UID: "6a2ae720-9576-413b-83da-0cb2c5d84f41"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:44:28.366680 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.366657 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a2ae720-9576-413b-83da-0cb2c5d84f41-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a2ae720-9576-413b-83da-0cb2c5d84f41" (UID: "6a2ae720-9576-413b-83da-0cb2c5d84f41"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:44:28.464317 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.464278 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-dshm\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:44:28.464317 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.464315 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-home\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:44:28.464317 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.464325 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmd29\" (UniqueName: \"kubernetes.io/projected/6a2ae720-9576-413b-83da-0cb2c5d84f41-kube-api-access-fmd29\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:44:28.464648 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.464333 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2ae720-9576-413b-83da-0cb2c5d84f41-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:44:28.464648 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:28.464343 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2ae720-9576-413b-83da-0cb2c5d84f41-model-cache\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:44:29.325055 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:29.325013 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h" Jul 06 20:44:29.348442 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:29.348408 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h"] Jul 06 20:44:29.353633 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:29.353607 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-bd79a608/e2e-lifecycle-model-bd79a608-kserve-7fd44db6f5-gql8h"] Jul 06 20:44:30.255712 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:44:30.255680 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a2ae720-9576-413b-83da-0cb2c5d84f41" path="/var/lib/kubelet/pods/6a2ae720-9576-413b-83da-0cb2c5d84f41/volumes" Jul 06 20:45:13.654594 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:45:13.654514 2559 controller.go:195] "Failed to update lease" err="Put \"https://a4c376c0a0b144bccb8b60521bb996ff-542fe4622e2eb115.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-202.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 06 20:45:23.655408 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:45:23.655356 2559 controller.go:195] "Failed to update lease" err="Put \"https://a4c376c0a0b144bccb8b60521bb996ff-542fe4622e2eb115.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-202.ec2.internal?timeout=10s\": context deadline exceeded" Jul 06 20:45:33.656636 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:45:33.656550 2559 controller.go:195] "Failed to update lease" err="Put \"https://a4c376c0a0b144bccb8b60521bb996ff-542fe4622e2eb115.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-202.ec2.internal?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 20:45:43.657210 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:45:43.657160 2559 controller.go:195] "Failed to update lease" err="Put \"https://a4c376c0a0b144bccb8b60521bb996ff-542fe4622e2eb115.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-202.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 06 20:45:44.221242 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221204 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221203 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221275 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xjp7h\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221205 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221203 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-zlqph\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221224 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221235 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221228 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221248 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-58zgd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221341 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-sf5s6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221217 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221338 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221294 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221356 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221391 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221388 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221403 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221418 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.221473 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221438 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221445 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97kgv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221484 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221511 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221518 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221530 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221517 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221545 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221579 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221586 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221594 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221612 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221627 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221641 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221646 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221635 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221672 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221703 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.222131 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221718 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rq42z\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221722 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221738 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221768 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221783 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221804 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221820 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ksdkk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221828 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221844 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221850 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z4f6j\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221865 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221893 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:45:44.221908 2559 controller.go:195] "Failed to update lease" err="Put \"https://a4c376c0a0b144bccb8b60521bb996ff-542fe4622e2eb115.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-202.ec2.internal?timeout=10s\": http2: client connection lost" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221938 2559 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221955 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221921 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221960 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-88kxf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221985 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222010 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223035 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222021 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b5xbg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.221936 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222039 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f4gw6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222045 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222069 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bfbrj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222070 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222100 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gqpc7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222118 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222134 2559 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222141 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222147 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222148 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222151 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222160 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222173 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222182 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gb6vl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222187 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9p58p\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222192 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.223715 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222197 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222211 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222222 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222227 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222248 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222241 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222257 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222269 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-njj8l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222274 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222278 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222288 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222292 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222309 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222320 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-82vcn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222327 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222331 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222347 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j5z9h\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222357 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224241 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222365 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zt57m\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222372 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8g8p6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222380 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222387 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222389 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222402 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222404 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222413 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222419 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222416 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222435 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cv8ipvluvi9c1\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222445 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rgc9c\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222445 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222459 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222459 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bafbhc0dlhfm7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222476 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222492 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222478 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.224826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222500 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222496 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222509 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hk74q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222512 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222495 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222538 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222537 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lh6mz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222603 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222612 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222620 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9vhmq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222650 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222658 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222659 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pkfc8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222672 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222686 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222711 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222723 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222728 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.225683 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222745 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222752 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222759 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222765 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222779 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222783 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222793 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222798 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lrrds\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222812 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222818 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bphd8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222814 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:44.226206 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:44.222823 2559 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t8qhr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding" Jul 06 20:45:45.027403 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.027365 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sf5s6\"" Jul 06 20:45:45.030468 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.030441 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 20:45:45.030781 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.030761 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:45:45.041640 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.041606 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f4gw6\"" Jul 06 20:45:45.041787 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.041712 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8g8p6\"" Jul 06 20:45:45.043548 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.043529 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.044717 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.044705 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:45:45.050572 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.050541 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.054447 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.054420 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:45:45.056969 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.056953 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rgc9c\"" Jul 06 20:45:45.057404 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.057392 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.058079 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.058066 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 20:45:45.072408 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.072382 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.074433 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.074417 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.083662 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.083637 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t8qhr\"" Jul 06 20:45:45.089237 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.089221 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ksdkk\"" Jul 06 20:45:45.091198 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.091186 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:45:45.092343 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.092327 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 20:45:45.093105 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.093091 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:45:45.102631 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.102614 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 20:45:45.106962 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.106946 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:45:45.117342 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.117324 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 20:45:45.124794 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.124774 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:45:45.124896 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.124836 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-88kxf\"" Jul 06 20:45:45.128142 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.128122 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z4f6j\"" Jul 06 20:45:45.129260 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.129237 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:45:45.144837 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.144811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zt57m\"" Jul 06 20:45:45.148379 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.148364 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:45:45.150167 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.150152 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.161616 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.161599 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:45:45.167687 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.167669 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.173220 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.173205 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bfbrj\"" Jul 06 20:45:45.176121 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.176106 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 20:45:45.188609 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.188592 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:45:45.192823 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.192805 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 20:45:45.193310 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.193295 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j5z9h\"" Jul 06 20:45:45.199257 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.199207 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:45:45.199257 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.199238 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 20:45:45.201201 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.201178 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:45:45.208681 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.208662 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:45:45.213820 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.213804 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.213820 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.213813 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 20:45:45.220237 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.220212 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:45:45.239398 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.239370 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 20:45:45.241787 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.241772 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.250489 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.250469 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:45:45.253458 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.253443 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:45:45.276264 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.276231 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 20:45:45.296803 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.296737 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.301871 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.301848 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pkfc8\"" Jul 06 20:45:45.307181 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.307166 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b5xbg\"" Jul 06 20:45:45.307709 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.307693 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:45:45.323158 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.323127 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:45:45.323158 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.323147 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.325086 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.325053 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:45:45.325785 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.325769 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:45:45.326507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.326494 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:45:45.334498 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.334478 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rq42z\"" Jul 06 20:45:45.334708 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.334694 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9vhmq\"" Jul 06 20:45:45.345787 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.345771 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xjp7h\"" Jul 06 20:45:45.349947 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.349931 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 20:45:45.363077 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.363057 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:45:45.364876 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.364860 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.367931 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.367914 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 20:45:45.371944 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.371930 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-njj8l\"" Jul 06 20:45:45.384513 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.384491 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:45:45.392991 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.392972 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:45:45.396069 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.396052 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:45:45.397046 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.397031 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:45:45.397263 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.397247 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9p58p\"" Jul 06 20:45:45.404299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.404283 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:45:45.407261 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.407245 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:45:45.412275 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.412260 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.417207 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.417192 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 20:45:45.420254 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.420236 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 20:45:45.422060 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.422043 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.423277 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.423264 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 20:45:45.429666 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.429650 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 20:45:45.438363 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.438341 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 20:45:45.440225 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.440209 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:45:45.448710 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.448689 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:45:45.450894 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.450879 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:45:45.456278 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.456261 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:45:45.462481 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.462465 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bphd8\"" Jul 06 20:45:45.472245 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.472225 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 20:45:45.473712 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.473697 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 20:45:45.474269 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.474255 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:45:45.484352 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.484331 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.508531 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.508502 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.509052 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.509036 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lrrds\"" Jul 06 20:45:45.514208 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.514193 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lh6mz\"" Jul 06 20:45:45.522436 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.522416 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:45:45.524762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.524747 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:45:45.526796 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.526780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.547808 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.547747 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:45:45.557433 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.557412 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:45:45.575427 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.575404 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 20:45:45.592098 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.592079 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.595155 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.595138 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 20:45:45.611343 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.611322 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:45:45.628083 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.628064 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:45:45.628976 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.628963 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.637045 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.637029 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:45:45.647671 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.647652 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:45:45.654903 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.654886 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 20:45:45.670817 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.670790 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-58zgd\"" Jul 06 20:45:45.675111 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.675096 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.677345 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.677328 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.679385 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.679369 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.680310 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.680298 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.686518 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.686503 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-82vcn\"" Jul 06 20:45:45.696112 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.696095 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zlqph\"" Jul 06 20:45:45.703641 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.703623 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 20:45:45.703700 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.703650 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.712935 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.712921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cv8ipvluvi9c1\"" Jul 06 20:45:45.714982 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.714968 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:45:45.723380 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.723359 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:45:45.725705 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.725690 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.733860 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.733841 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:45:45.736904 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.736889 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:45:45.741988 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.741969 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.742072 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.742028 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hk74q\"" Jul 06 20:45:45.742979 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.742966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:45:45.746882 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.746865 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gb6vl\"" Jul 06 20:45:45.752404 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.752389 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gqpc7\"" Jul 06 20:45:45.753182 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.753168 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97kgv\"" Jul 06 20:45:45.756188 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.756173 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bafbhc0dlhfm7\"" Jul 06 20:45:45.758142 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.758128 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.767488 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.767472 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 20:45:45.775949 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.775933 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:45:45.789824 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.789803 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:45:45.791341 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.791325 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:45:45.804919 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.804854 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.818333 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.818308 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:45:45.818443 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.818372 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:45:45.819234 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.819219 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 20:45:45.822089 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:45.822062 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:45:47.661827 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:47.661795 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:45:47.662263 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:47.661843 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:45:47.662263 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:47.661857 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:45:47.662263 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:45:47.661877 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-202.ec2.internal" event="NodeReady" Jul 06 20:46:46.144026 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.143986 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk"] Jul 06 20:46:46.144513 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.144337 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a2ae720-9576-413b-83da-0cb2c5d84f41" containerName="main" Jul 06 20:46:46.144513 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.144349 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a2ae720-9576-413b-83da-0cb2c5d84f41" containerName="main" Jul 06 20:46:46.144513 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.144449 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a2ae720-9576-413b-83da-0cb2c5d84f41" containerName="main" Jul 06 20:46:46.147453 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.147434 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.151033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.151005 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-37baf2\"/\"kube-root-ca.crt\"" Jul 06 20:46:46.151033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.151021 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-37baf2\"/\"test-model-37baf2-kserve-self-signed-certs\"" Jul 06 20:46:46.151263 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.151042 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-37baf2\"/\"openshift-service-ca.crt\"" Jul 06 20:46:46.151263 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.151065 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-37baf2\"/\"default-dockercfg-sl9dx\"" Jul 06 20:46:46.157769 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.157741 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk"] Jul 06 20:46:46.214049 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.214009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2dd\" (UniqueName: \"kubernetes.io/projected/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-kube-api-access-gd2dd\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.214235 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.214065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tls-certs\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.214235 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.214099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-model-cache\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.214235 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.214121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-dshm\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.214235 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.214139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-home\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.214235 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.214213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tmp-dir\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315250 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tmp-dir\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315430 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2dd\" (UniqueName: \"kubernetes.io/projected/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-kube-api-access-gd2dd\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315430 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tls-certs\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315430 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-model-cache\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315430 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-dshm\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315430 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-home\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315775 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tmp-dir\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315831 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315772 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-model-cache\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.315831 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.315810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-home\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.317838 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.317801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-dshm\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.318248 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.318225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tls-certs\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.323613 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.323589 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2dd\" (UniqueName: \"kubernetes.io/projected/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-kube-api-access-gd2dd\") pod \"test-model-37baf2-kserve-6f44f7f459-ggwmk\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.457955 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.457903 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:46.597865 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.597732 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk"] Jul 06 20:46:46.600842 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:46:46.600813 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaa0d668_d0c1_42dd_be3c_8a6d41b3b576.slice/crio-3ca5980ef6d2dad5c86a2b2d06aad08b186008b37aecdb2adf181d2b51be9f64 WatchSource:0}: Error finding container 3ca5980ef6d2dad5c86a2b2d06aad08b186008b37aecdb2adf181d2b51be9f64: Status 404 returned error can't find the container with id 3ca5980ef6d2dad5c86a2b2d06aad08b186008b37aecdb2adf181d2b51be9f64 Jul 06 20:46:46.953304 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.953270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" event={"ID":"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576","Type":"ContainerStarted","Data":"b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a"} Jul 06 20:46:46.953304 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.953311 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" event={"ID":"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576","Type":"ContainerStarted","Data":"3ca5980ef6d2dad5c86a2b2d06aad08b186008b37aecdb2adf181d2b51be9f64"} Jul 06 20:46:46.970634 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:46.970542 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" podStartSLOduration=0.970521117 podStartE2EDuration="970.521117ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:46:46.969834833 +0000 UTC m=+1919.302822735" watchObservedRunningTime="2026-07-06 20:46:46.970521117 +0000 UTC m=+1919.303508976" Jul 06 20:46:56.458572 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:56.458528 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:56.459218 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:56.458600 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:56.471431 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:56.471399 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:46:57.011314 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:46:57.011285 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:47:36.393508 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:36.393472 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk"] Jul 06 20:47:51.414441 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.414324 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" podUID="eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" containerName="main" containerID="cri-o://b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a" gracePeriod=45 Jul 06 20:47:51.674669 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.674591 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:47:51.820814 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.820758 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd2dd\" (UniqueName: \"kubernetes.io/projected/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-kube-api-access-gd2dd\") pod \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " Jul 06 20:47:51.820814 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.820823 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-home\") pod \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " Jul 06 20:47:51.821065 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.820860 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-dshm\") pod \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " Jul 06 20:47:51.821065 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.820903 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tmp-dir\") pod \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " Jul 06 20:47:51.821065 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.820948 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tls-certs\") pod \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " Jul 06 20:47:51.821065 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.820987 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-model-cache\") pod \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\" (UID: \"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576\") " Jul 06 20:47:51.821280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.821166 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-home" (OuterVolumeSpecName: "home") pod "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" (UID: "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:47:51.821280 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.821204 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" (UID: "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:47:51.821386 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.821290 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-home\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:47:51.821386 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.821323 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tmp-dir\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:47:51.821386 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.821344 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-model-cache" (OuterVolumeSpecName: "model-cache") pod "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" (UID: "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:47:51.823403 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.823374 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-dshm" (OuterVolumeSpecName: "dshm") pod "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" (UID: "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:47:51.823403 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.823385 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-kube-api-access-gd2dd" (OuterVolumeSpecName: "kube-api-access-gd2dd") pod "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" (UID: "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576"). InnerVolumeSpecName "kube-api-access-gd2dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:47:51.823576 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.823388 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" (UID: "eaa0d668-d0c1-42dd-be3c-8a6d41b3b576"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:47:51.922765 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.922724 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd2dd\" (UniqueName: \"kubernetes.io/projected/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-kube-api-access-gd2dd\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:47:51.922765 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.922757 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-dshm\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:47:51.922765 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.922768 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:47:51.922765 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:51.922777 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576-model-cache\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:47:52.256507 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.256472 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" containerID="b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a" exitCode=0 Jul 06 20:47:52.256728 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.256518 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" Jul 06 20:47:52.256728 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.256543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" event={"ID":"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576","Type":"ContainerDied","Data":"b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a"} Jul 06 20:47:52.256728 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.256593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk" event={"ID":"eaa0d668-d0c1-42dd-be3c-8a6d41b3b576","Type":"ContainerDied","Data":"3ca5980ef6d2dad5c86a2b2d06aad08b186008b37aecdb2adf181d2b51be9f64"} Jul 06 20:47:52.256728 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.256611 2559 scope.go:117] "RemoveContainer" containerID="b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a" Jul 06 20:47:52.266788 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.266765 2559 scope.go:117] "RemoveContainer" containerID="b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a" Jul 06 20:47:52.267038 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:47:52.267021 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a\": container with ID starting with b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a not found: ID does not exist" containerID="b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a" Jul 06 20:47:52.267089 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.267046 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a"} err="failed to get container status \"b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a\": rpc error: code = NotFound desc = could not find container \"b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a\": container with ID starting with b23c7e158d7f124bbf7dd4494e65049945caf512831032ccdb16ed246515174a not found: ID does not exist" Jul 06 20:47:52.280219 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.280194 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk"] Jul 06 20:47:52.284330 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:52.284306 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-37baf2/test-model-37baf2-kserve-6f44f7f459-ggwmk"] Jul 06 20:47:54.254740 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:47:54.254701 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" path="/var/lib/kubelet/pods/eaa0d668-d0c1-42dd-be3c-8a6d41b3b576/volumes" Jul 06 20:49:43.553533 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.553497 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96"] Jul 06 20:49:43.554033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.553867 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" containerName="main" Jul 06 20:49:43.554033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.553878 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" containerName="main" Jul 06 20:49:43.554033 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.553948 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa0d668-d0c1-42dd-be3c-8a6d41b3b576" containerName="main" Jul 06 20:49:43.556934 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.556915 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.560508 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.560486 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7306a9\"/\"kube-root-ca.crt\"" Jul 06 20:49:43.561629 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.561599 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7306a9\"/\"auth-test-model-7306a9-kserve-self-signed-certs\"" Jul 06 20:49:43.561727 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.561602 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7306a9\"/\"default-dockercfg-6vkvc\"" Jul 06 20:49:43.561727 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.561698 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7306a9\"/\"openshift-service-ca.crt\"" Jul 06 20:49:43.576486 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.576455 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96"] Jul 06 20:49:43.603298 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.603262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-dshm\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.603298 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.603294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-model-cache\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.603495 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.603328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tmp-dir\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.603495 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.603375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gp6z\" (UniqueName: \"kubernetes.io/projected/1ca12b87-de14-460d-967c-ca40fb1bf8c0-kube-api-access-5gp6z\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.603495 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.603448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-home\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.603638 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.603508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tls-certs\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.704825 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.704791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tls-certs\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.705016 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.704832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-dshm\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.705016 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.705003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-model-cache\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.705148 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.705098 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tmp-dir\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.705148 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.705124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gp6z\" (UniqueName: \"kubernetes.io/projected/1ca12b87-de14-460d-967c-ca40fb1bf8c0-kube-api-access-5gp6z\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.705271 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.705245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-home\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.705418 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.705392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-model-cache\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.705482 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.705468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tmp-dir\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.705655 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.705634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-home\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.707225 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.707201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-dshm\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.707481 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.707461 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tls-certs\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.714220 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.714197 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gp6z\" (UniqueName: \"kubernetes.io/projected/1ca12b87-de14-460d-967c-ca40fb1bf8c0-kube-api-access-5gp6z\") pod \"auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:43.867481 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:43.867373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:44.006132 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:44.006106 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96"] Jul 06 20:49:44.008302 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:49:44.008273 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ca12b87_de14_460d_967c_ca40fb1bf8c0.slice/crio-ef73c4ffbdfb7001f3e7edde8fff82dfb33f1aaabc883742a8160a16af4e1f00 WatchSource:0}: Error finding container ef73c4ffbdfb7001f3e7edde8fff82dfb33f1aaabc883742a8160a16af4e1f00: Status 404 returned error can't find the container with id ef73c4ffbdfb7001f3e7edde8fff82dfb33f1aaabc883742a8160a16af4e1f00 Jul 06 20:49:44.783576 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:44.783535 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" event={"ID":"1ca12b87-de14-460d-967c-ca40fb1bf8c0","Type":"ContainerStarted","Data":"1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488"} Jul 06 20:49:44.784096 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:44.783601 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" event={"ID":"1ca12b87-de14-460d-967c-ca40fb1bf8c0","Type":"ContainerStarted","Data":"ef73c4ffbdfb7001f3e7edde8fff82dfb33f1aaabc883742a8160a16af4e1f00"} Jul 06 20:49:44.802433 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:44.802385 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" podStartSLOduration=1.802369193 podStartE2EDuration="1.802369193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:44.801964785 +0000 UTC m=+2097.134952640" watchObservedRunningTime="2026-07-06 20:49:44.802369193 +0000 UTC m=+2097.135357050" Jul 06 20:49:53.867540 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:53.867502 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:53.868048 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:53.867786 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:53.880594 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:53.880548 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:49:54.839660 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:49:54.839629 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:51:49.292303 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:51:49.292264 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96"] Jul 06 20:52:04.312450 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.312387 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" podUID="1ca12b87-de14-460d-967c-ca40fb1bf8c0" containerName="main" containerID="cri-o://1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488" gracePeriod=45 Jul 06 20:52:04.570945 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.570878 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:52:04.721335 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721298 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gp6z\" (UniqueName: \"kubernetes.io/projected/1ca12b87-de14-460d-967c-ca40fb1bf8c0-kube-api-access-5gp6z\") pod \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " Jul 06 20:52:04.721335 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721342 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-dshm\") pod \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " Jul 06 20:52:04.721592 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721389 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-home\") pod \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " Jul 06 20:52:04.721592 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721432 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-model-cache\") pod \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " Jul 06 20:52:04.721592 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721483 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tmp-dir\") pod \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " Jul 06 20:52:04.721592 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721519 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tls-certs\") pod \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\" (UID: \"1ca12b87-de14-460d-967c-ca40fb1bf8c0\") " Jul 06 20:52:04.721809 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721721 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-home" (OuterVolumeSpecName: "home") pod "1ca12b87-de14-460d-967c-ca40fb1bf8c0" (UID: "1ca12b87-de14-460d-967c-ca40fb1bf8c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:52:04.721809 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721769 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ca12b87-de14-460d-967c-ca40fb1bf8c0" (UID: "1ca12b87-de14-460d-967c-ca40fb1bf8c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:52:04.721809 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721787 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ca12b87-de14-460d-967c-ca40fb1bf8c0" (UID: "1ca12b87-de14-460d-967c-ca40fb1bf8c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:52:04.721924 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721865 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-home\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.721924 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721881 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-model-cache\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.721924 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.721892 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tmp-dir\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.723784 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.723750 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ca12b87-de14-460d-967c-ca40fb1bf8c0" (UID: "1ca12b87-de14-460d-967c-ca40fb1bf8c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:52:04.723899 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.723791 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-dshm" (OuterVolumeSpecName: "dshm") pod "1ca12b87-de14-460d-967c-ca40fb1bf8c0" (UID: "1ca12b87-de14-460d-967c-ca40fb1bf8c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:52:04.723899 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.723826 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ca12b87-de14-460d-967c-ca40fb1bf8c0-kube-api-access-5gp6z" (OuterVolumeSpecName: "kube-api-access-5gp6z") pod "1ca12b87-de14-460d-967c-ca40fb1bf8c0" (UID: "1ca12b87-de14-460d-967c-ca40fb1bf8c0"). InnerVolumeSpecName "kube-api-access-5gp6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:52:04.822533 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.822438 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gp6z\" (UniqueName: \"kubernetes.io/projected/1ca12b87-de14-460d-967c-ca40fb1bf8c0-kube-api-access-5gp6z\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.822533 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.822471 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca12b87-de14-460d-967c-ca40fb1bf8c0-dshm\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:52:04.822533 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:04.822481 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca12b87-de14-460d-967c-ca40fb1bf8c0-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:52:05.431439 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.431405 2559 generic.go:356] "Generic (PLEG): container finished" podID="1ca12b87-de14-460d-967c-ca40fb1bf8c0" containerID="1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488" exitCode=0 Jul 06 20:52:05.431897 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.431449 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" Jul 06 20:52:05.431897 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.431504 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" event={"ID":"1ca12b87-de14-460d-967c-ca40fb1bf8c0","Type":"ContainerDied","Data":"1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488"} Jul 06 20:52:05.431897 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.431547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96" event={"ID":"1ca12b87-de14-460d-967c-ca40fb1bf8c0","Type":"ContainerDied","Data":"ef73c4ffbdfb7001f3e7edde8fff82dfb33f1aaabc883742a8160a16af4e1f00"} Jul 06 20:52:05.431897 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.431586 2559 scope.go:117] "RemoveContainer" containerID="1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488" Jul 06 20:52:05.440399 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.440383 2559 scope.go:117] "RemoveContainer" containerID="1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488" Jul 06 20:52:05.440678 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:52:05.440660 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488\": container with ID starting with 1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488 not found: ID does not exist" containerID="1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488" Jul 06 20:52:05.440739 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.440686 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488"} err="failed to get container status \"1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488\": rpc error: code = NotFound desc = could not find container \"1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488\": container with ID starting with 1f48fd76b1065fd5848b66df8314f4a0323c9caca15c753583019b5c1bf08488 not found: ID does not exist" Jul 06 20:52:05.453908 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.453876 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96"] Jul 06 20:52:05.457935 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:05.457906 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/auth-test-model-7306a9-kserve-bb9bfc9c9-5qh96"] Jul 06 20:52:06.258759 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:06.257208 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ca12b87-de14-460d-967c-ca40fb1bf8c0" path="/var/lib/kubelet/pods/1ca12b87-de14-460d-967c-ca40fb1bf8c0/volumes" Jul 06 20:52:14.866031 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.865940 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78"] Jul 06 20:52:14.868365 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.866286 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca12b87-de14-460d-967c-ca40fb1bf8c0" containerName="main" Jul 06 20:52:14.868365 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.866297 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca12b87-de14-460d-967c-ca40fb1bf8c0" containerName="main" Jul 06 20:52:14.868365 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.866362 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ca12b87-de14-460d-967c-ca40fb1bf8c0" containerName="main" Jul 06 20:52:14.869274 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.869251 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:14.876369 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.876345 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d729fa\"/\"default-dockercfg-5zgpd\"" Jul 06 20:52:14.876512 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.876385 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d729fa\"/\"openshift-service-ca.crt\"" Jul 06 20:52:14.876512 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.876397 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d729fa\"/\"kube-root-ca.crt\"" Jul 06 20:52:14.876685 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.876671 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d729fa\"/\"sub-test-model-d729fa-kserve-self-signed-certs\"" Jul 06 20:52:14.889285 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:14.889249 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78"] Jul 06 20:52:15.011281 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.011216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-model-cache\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.011281 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.011293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-dshm\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.011739 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.011322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tls-certs\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.011739 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.011347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-home\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.011739 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.011392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tmp-dir\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.011739 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.011427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8sg2\" (UniqueName: \"kubernetes.io/projected/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-kube-api-access-s8sg2\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112143 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tmp-dir\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112332 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8sg2\" (UniqueName: \"kubernetes.io/projected/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-kube-api-access-s8sg2\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112332 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-model-cache\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112332 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-dshm\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112501 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tls-certs\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112501 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-home\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112524 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tmp-dir\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112620 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112590 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-model-cache\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.112770 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.112750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-home\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.114506 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.114486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-dshm\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.114796 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.114777 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tls-certs\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.126247 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.126177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8sg2\" (UniqueName: \"kubernetes.io/projected/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-kube-api-access-s8sg2\") pod \"sub-test-model-d729fa-kserve-778f4b8f57-4lx78\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.179037 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.178993 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:15.323477 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.323449 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78"] Jul 06 20:52:15.326171 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:52:15.326148 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dbab1c0_a0fe_422b_8884_a405f2baa2e6.slice/crio-5b0512f6b0dc0d2c5b61e5191b5ed18051029928af478448900ae6f19fca4ed5 WatchSource:0}: Error finding container 5b0512f6b0dc0d2c5b61e5191b5ed18051029928af478448900ae6f19fca4ed5: Status 404 returned error can't find the container with id 5b0512f6b0dc0d2c5b61e5191b5ed18051029928af478448900ae6f19fca4ed5 Jul 06 20:52:15.481834 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.481799 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" event={"ID":"5dbab1c0-a0fe-422b-8884-a405f2baa2e6","Type":"ContainerStarted","Data":"2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6"} Jul 06 20:52:15.481834 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.481841 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" event={"ID":"5dbab1c0-a0fe-422b-8884-a405f2baa2e6","Type":"ContainerStarted","Data":"5b0512f6b0dc0d2c5b61e5191b5ed18051029928af478448900ae6f19fca4ed5"} Jul 06 20:52:15.515106 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:15.515053 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" podStartSLOduration=1.515035798 podStartE2EDuration="1.515035798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:52:15.511577112 +0000 UTC m=+2247.844564966" watchObservedRunningTime="2026-07-06 20:52:15.515035798 +0000 UTC m=+2247.848023682" Jul 06 20:52:25.179826 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:25.179776 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:25.180331 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:25.179852 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:25.192388 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:25.192351 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:25.537256 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:25.537167 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:52:50.899226 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:52:50.899190 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78"] Jul 06 20:53:05.919375 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:05.919326 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" podUID="5dbab1c0-a0fe-422b-8884-a405f2baa2e6" containerName="main" containerID="cri-o://2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6" gracePeriod=45 Jul 06 20:53:06.170747 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.170669 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:53:06.280086 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280053 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-model-cache\") pod \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " Jul 06 20:53:06.280279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280124 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tmp-dir\") pod \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " Jul 06 20:53:06.280279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280153 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-home\") pod \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " Jul 06 20:53:06.280279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280176 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tls-certs\") pod \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " Jul 06 20:53:06.280279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280193 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8sg2\" (UniqueName: \"kubernetes.io/projected/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-kube-api-access-s8sg2\") pod \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " Jul 06 20:53:06.280279 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280251 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-dshm\") pod \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\" (UID: \"5dbab1c0-a0fe-422b-8884-a405f2baa2e6\") " Jul 06 20:53:06.280531 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280408 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "5dbab1c0-a0fe-422b-8884-a405f2baa2e6" (UID: "5dbab1c0-a0fe-422b-8884-a405f2baa2e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:53:06.280531 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280469 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-home" (OuterVolumeSpecName: "home") pod "5dbab1c0-a0fe-422b-8884-a405f2baa2e6" (UID: "5dbab1c0-a0fe-422b-8884-a405f2baa2e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:53:06.280531 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280465 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5dbab1c0-a0fe-422b-8884-a405f2baa2e6" (UID: "5dbab1c0-a0fe-422b-8884-a405f2baa2e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:53:06.280672 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280590 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tmp-dir\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:53:06.280672 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280603 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-home\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:53:06.280672 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.280611 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-model-cache\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:53:06.282643 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.282604 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-dshm" (OuterVolumeSpecName: "dshm") pod "5dbab1c0-a0fe-422b-8884-a405f2baa2e6" (UID: "5dbab1c0-a0fe-422b-8884-a405f2baa2e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:53:06.282762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.282662 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5dbab1c0-a0fe-422b-8884-a405f2baa2e6" (UID: "5dbab1c0-a0fe-422b-8884-a405f2baa2e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:53:06.282762 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.282703 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-kube-api-access-s8sg2" (OuterVolumeSpecName: "kube-api-access-s8sg2") pod "5dbab1c0-a0fe-422b-8884-a405f2baa2e6" (UID: "5dbab1c0-a0fe-422b-8884-a405f2baa2e6"). InnerVolumeSpecName "kube-api-access-s8sg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:53:06.381988 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.381935 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:53:06.381988 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.381982 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8sg2\" (UniqueName: \"kubernetes.io/projected/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-kube-api-access-s8sg2\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:53:06.381988 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.381993 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dbab1c0-a0fe-422b-8884-a405f2baa2e6-dshm\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:53:06.710814 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.710778 2559 generic.go:356] "Generic (PLEG): container finished" podID="5dbab1c0-a0fe-422b-8884-a405f2baa2e6" containerID="2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6" exitCode=0 Jul 06 20:53:06.711017 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.710830 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" event={"ID":"5dbab1c0-a0fe-422b-8884-a405f2baa2e6","Type":"ContainerDied","Data":"2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6"} Jul 06 20:53:06.711017 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.710838 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" Jul 06 20:53:06.711017 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.710862 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78" event={"ID":"5dbab1c0-a0fe-422b-8884-a405f2baa2e6","Type":"ContainerDied","Data":"5b0512f6b0dc0d2c5b61e5191b5ed18051029928af478448900ae6f19fca4ed5"} Jul 06 20:53:06.711017 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.710878 2559 scope.go:117] "RemoveContainer" containerID="2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6" Jul 06 20:53:06.719667 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.719644 2559 scope.go:117] "RemoveContainer" containerID="2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6" Jul 06 20:53:06.719927 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:53:06.719910 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6\": container with ID starting with 2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6 not found: ID does not exist" containerID="2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6" Jul 06 20:53:06.719968 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.719937 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6"} err="failed to get container status \"2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6\": rpc error: code = NotFound desc = could not find container \"2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6\": container with ID starting with 2741f371d50014aa861e73bd66da790f9f4bddea36bcb50462da68f33b6167b6 not found: ID does not exist" Jul 06 20:53:06.732808 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.732779 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78"] Jul 06 20:53:06.737110 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:06.737088 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d729fa/sub-test-model-d729fa-kserve-778f4b8f57-4lx78"] Jul 06 20:53:08.254757 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:08.254721 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dbab1c0-a0fe-422b-8884-a405f2baa2e6" path="/var/lib/kubelet/pods/5dbab1c0-a0fe-422b-8884-a405f2baa2e6/volumes" Jul 06 20:53:11.853954 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.853913 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj"] Jul 06 20:53:11.854730 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.854460 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dbab1c0-a0fe-422b-8884-a405f2baa2e6" containerName="main" Jul 06 20:53:11.854730 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.854479 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dbab1c0-a0fe-422b-8884-a405f2baa2e6" containerName="main" Jul 06 20:53:11.854730 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.854589 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dbab1c0-a0fe-422b-8884-a405f2baa2e6" containerName="main" Jul 06 20:53:11.859040 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.859016 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:11.863201 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.863141 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7306a9\"/\"openshift-service-ca.crt\"" Jul 06 20:53:11.863201 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.863146 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7306a9\"/\"default-dockercfg-6vkvc\"" Jul 06 20:53:11.863425 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.863146 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7306a9\"/\"rate-test-model-7306a9-kserve-self-signed-certs\"" Jul 06 20:53:11.863425 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.863155 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7306a9\"/\"kube-root-ca.crt\"" Jul 06 20:53:11.870617 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.870592 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj"] Jul 06 20:53:11.926210 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.926168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-tmp-dir\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:11.926210 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.926205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfcqp\" (UniqueName: \"kubernetes.io/projected/3290165b-2237-45fd-8e75-76e820bf7da6-kube-api-access-wfcqp\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:11.926444 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.926225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-home\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:11.926444 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.926280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3290165b-2237-45fd-8e75-76e820bf7da6-tls-certs\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:11.926444 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.926313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-model-cache\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:11.926444 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:11.926334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-dshm\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.026787 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.026748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-home\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.026992 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.026800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3290165b-2237-45fd-8e75-76e820bf7da6-tls-certs\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.026992 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.026834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-model-cache\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.026992 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.026858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-dshm\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.027155 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.027013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-tmp-dir\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.027155 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.027053 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfcqp\" (UniqueName: \"kubernetes.io/projected/3290165b-2237-45fd-8e75-76e820bf7da6-kube-api-access-wfcqp\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.027265 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.027177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-home\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.027321 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.027284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-model-cache\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.027361 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.027322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-tmp-dir\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.029198 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.029179 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-dshm\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.029385 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.029368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3290165b-2237-45fd-8e75-76e820bf7da6-tls-certs\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.036198 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.036176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfcqp\" (UniqueName: \"kubernetes.io/projected/3290165b-2237-45fd-8e75-76e820bf7da6-kube-api-access-wfcqp\") pod \"rate-test-model-7306a9-kserve-5956b4859f-w6gpj\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.168740 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.168701 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:12.309027 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.308996 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj"] Jul 06 20:53:12.311367 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:53:12.311330 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3290165b_2237_45fd_8e75_76e820bf7da6.slice/crio-3557f46833d7609cdc72f4fef165e91d75257c41ea5c5e58b0c5e2c12202941e WatchSource:0}: Error finding container 3557f46833d7609cdc72f4fef165e91d75257c41ea5c5e58b0c5e2c12202941e: Status 404 returned error can't find the container with id 3557f46833d7609cdc72f4fef165e91d75257c41ea5c5e58b0c5e2c12202941e Jul 06 20:53:12.739191 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.739151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" event={"ID":"3290165b-2237-45fd-8e75-76e820bf7da6","Type":"ContainerStarted","Data":"de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903"} Jul 06 20:53:12.739392 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.739204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" event={"ID":"3290165b-2237-45fd-8e75-76e820bf7da6","Type":"ContainerStarted","Data":"3557f46833d7609cdc72f4fef165e91d75257c41ea5c5e58b0c5e2c12202941e"} Jul 06 20:53:12.759649 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:12.759593 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" podStartSLOduration=1.7595500849999999 podStartE2EDuration="1.759550085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:53:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:53:12.759193936 +0000 UTC m=+2305.092181797" watchObservedRunningTime="2026-07-06 20:53:12.759550085 +0000 UTC m=+2305.092537940" Jul 06 20:53:22.169196 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:22.169151 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:22.169760 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:22.169219 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:22.181706 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:22.181679 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:53:22.796592 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:53:22.796537 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:54:30.616877 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:30.616838 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj"] Jul 06 20:54:45.636541 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.636495 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" podUID="3290165b-2237-45fd-8e75-76e820bf7da6" containerName="main" containerID="cri-o://de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903" gracePeriod=45 Jul 06 20:54:45.895703 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.895638 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:54:45.980197 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980160 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-tmp-dir\") pod \"3290165b-2237-45fd-8e75-76e820bf7da6\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " Jul 06 20:54:45.980418 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980234 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfcqp\" (UniqueName: \"kubernetes.io/projected/3290165b-2237-45fd-8e75-76e820bf7da6-kube-api-access-wfcqp\") pod \"3290165b-2237-45fd-8e75-76e820bf7da6\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " Jul 06 20:54:45.980418 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980263 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-home\") pod \"3290165b-2237-45fd-8e75-76e820bf7da6\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " Jul 06 20:54:45.980418 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980330 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-model-cache\") pod \"3290165b-2237-45fd-8e75-76e820bf7da6\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " Jul 06 20:54:45.980418 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980376 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3290165b-2237-45fd-8e75-76e820bf7da6-tls-certs\") pod \"3290165b-2237-45fd-8e75-76e820bf7da6\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " Jul 06 20:54:45.980418 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980397 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-dshm\") pod \"3290165b-2237-45fd-8e75-76e820bf7da6\" (UID: \"3290165b-2237-45fd-8e75-76e820bf7da6\") " Jul 06 20:54:45.980696 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980507 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3290165b-2237-45fd-8e75-76e820bf7da6" (UID: "3290165b-2237-45fd-8e75-76e820bf7da6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:54:45.980696 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980648 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-home" (OuterVolumeSpecName: "home") pod "3290165b-2237-45fd-8e75-76e820bf7da6" (UID: "3290165b-2237-45fd-8e75-76e820bf7da6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:54:45.980696 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980663 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-model-cache" (OuterVolumeSpecName: "model-cache") pod "3290165b-2237-45fd-8e75-76e820bf7da6" (UID: "3290165b-2237-45fd-8e75-76e820bf7da6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:54:45.980849 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980779 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-model-cache\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:54:45.980849 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980798 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-tmp-dir\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:54:45.980849 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.980810 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-home\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:54:45.982653 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.982626 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3290165b-2237-45fd-8e75-76e820bf7da6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3290165b-2237-45fd-8e75-76e820bf7da6" (UID: "3290165b-2237-45fd-8e75-76e820bf7da6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:54:45.982765 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.982653 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-dshm" (OuterVolumeSpecName: "dshm") pod "3290165b-2237-45fd-8e75-76e820bf7da6" (UID: "3290165b-2237-45fd-8e75-76e820bf7da6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:54:45.982765 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:45.982686 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3290165b-2237-45fd-8e75-76e820bf7da6-kube-api-access-wfcqp" (OuterVolumeSpecName: "kube-api-access-wfcqp") pod "3290165b-2237-45fd-8e75-76e820bf7da6" (UID: "3290165b-2237-45fd-8e75-76e820bf7da6"). InnerVolumeSpecName "kube-api-access-wfcqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:54:46.081892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.081854 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfcqp\" (UniqueName: \"kubernetes.io/projected/3290165b-2237-45fd-8e75-76e820bf7da6-kube-api-access-wfcqp\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:54:46.081892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.081889 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3290165b-2237-45fd-8e75-76e820bf7da6-tls-certs\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:54:46.081892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.081901 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3290165b-2237-45fd-8e75-76e820bf7da6-dshm\") on node \"ip-10-0-136-202.ec2.internal\" DevicePath \"\"" Jul 06 20:54:46.168608 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.168544 2559 generic.go:356] "Generic (PLEG): container finished" podID="3290165b-2237-45fd-8e75-76e820bf7da6" containerID="de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903" exitCode=0 Jul 06 20:54:46.168814 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.168614 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" Jul 06 20:54:46.168814 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.168705 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" event={"ID":"3290165b-2237-45fd-8e75-76e820bf7da6","Type":"ContainerDied","Data":"de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903"} Jul 06 20:54:46.168814 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.168747 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj" event={"ID":"3290165b-2237-45fd-8e75-76e820bf7da6","Type":"ContainerDied","Data":"3557f46833d7609cdc72f4fef165e91d75257c41ea5c5e58b0c5e2c12202941e"} Jul 06 20:54:46.168814 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.168769 2559 scope.go:117] "RemoveContainer" containerID="de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903" Jul 06 20:54:46.180521 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.180498 2559 scope.go:117] "RemoveContainer" containerID="de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903" Jul 06 20:54:46.180959 ip-10-0-136-202 kubenswrapper[2559]: E0706 20:54:46.180907 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903\": container with ID starting with de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903 not found: ID does not exist" containerID="de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903" Jul 06 20:54:46.181052 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.180969 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903"} err="failed to get container status \"de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903\": rpc error: code = NotFound desc = could not find container \"de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903\": container with ID starting with de03daad76eaa7ae621106348f06ed674bc38de635d49b7d5ee1ce359d279903 not found: ID does not exist" Jul 06 20:54:46.192475 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.192440 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj"] Jul 06 20:54:46.193892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.193871 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7306a9/rate-test-model-7306a9-kserve-5956b4859f-w6gpj"] Jul 06 20:54:46.254996 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:54:46.254962 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3290165b-2237-45fd-8e75-76e820bf7da6" path="/var/lib/kubelet/pods/3290165b-2237-45fd-8e75-76e820bf7da6/volumes" Jul 06 20:55:28.631186 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:28.631155 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b6b7b7bb-zptlq_6cb7994e-e443-4b21-9d64-bb8a059415d4/copy-manifests/0.log" Jul 06 20:55:28.638353 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:28.638325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b6b7b7bb-zptlq_6cb7994e-e443-4b21-9d64-bb8a059415d4/manager/0.log" Jul 06 20:55:31.352822 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:31.352785 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gz744_a61d846f-6ce4-49fe-a08c-1d9a1d0b861d/discovery/0.log" Jul 06 20:55:31.467212 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:31.467180 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9c87b66f-4mpw7_d2f22ca5-3cea-411d-b593-ce87e7f45291/kube-auth-proxy/0.log" Jul 06 20:55:32.608989 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:32.608955 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fzvqj_b3d4d9e7-900b-440b-9217-823f94b86d71/main/0.log" Jul 06 20:55:40.379676 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:40.379634 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t8dz6_9e3177b7-2789-4fe3-9c3c-26949144b765/global-pull-secret-syncer/0.log" Jul 06 20:55:40.508755 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:40.508724 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mrtnc_40f05366-8faa-433c-a760-97c707e1d325/konnectivity-agent/0.log" Jul 06 20:55:40.613313 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:40.613277 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-202.ec2.internal_a35c3367aea0364e635c7dba529cb3ff/haproxy/0.log" Jul 06 20:55:46.942779 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:46.942746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_366cfd01-b0af-4949-9966-f67b1b08f962/alertmanager/0.log" Jul 06 20:55:46.967030 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:46.966995 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_366cfd01-b0af-4949-9966-f67b1b08f962/config-reloader/0.log" Jul 06 20:55:46.992892 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:46.992862 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_366cfd01-b0af-4949-9966-f67b1b08f962/kube-rbac-proxy-web/0.log" Jul 06 20:55:47.020980 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.020907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_366cfd01-b0af-4949-9966-f67b1b08f962/kube-rbac-proxy/0.log" Jul 06 20:55:47.056865 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.056834 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_366cfd01-b0af-4949-9966-f67b1b08f962/kube-rbac-proxy-metric/0.log" Jul 06 20:55:47.078799 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.078775 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_366cfd01-b0af-4949-9966-f67b1b08f962/prom-label-proxy/0.log" Jul 06 20:55:47.105909 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.105865 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_366cfd01-b0af-4949-9966-f67b1b08f962/init-config-reloader/0.log" Jul 06 20:55:47.342316 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.342216 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lsx9l_19b1d595-1b1a-4ecf-ad53-5b9d629a0d82/monitoring-plugin/0.log" Jul 06 20:55:47.494176 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.494146 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45p4r_c9727583-c3b6-4db4-a6c0-8d160972780e/node-exporter/0.log" Jul 06 20:55:47.517733 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.517699 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45p4r_c9727583-c3b6-4db4-a6c0-8d160972780e/kube-rbac-proxy/0.log" Jul 06 20:55:47.539836 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.539808 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45p4r_c9727583-c3b6-4db4-a6c0-8d160972780e/init-textfile/0.log" Jul 06 20:55:47.788072 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.788041 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e25d3d5-6f8e-48f2-beb8-865194cbf3ef/prometheus/0.log" Jul 06 20:55:47.823046 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.823021 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e25d3d5-6f8e-48f2-beb8-865194cbf3ef/config-reloader/0.log" Jul 06 20:55:47.856437 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.856395 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e25d3d5-6f8e-48f2-beb8-865194cbf3ef/thanos-sidecar/0.log" Jul 06 20:55:47.922573 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.922528 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e25d3d5-6f8e-48f2-beb8-865194cbf3ef/kube-rbac-proxy-web/0.log" Jul 06 20:55:47.982287 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:47.982260 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e25d3d5-6f8e-48f2-beb8-865194cbf3ef/kube-rbac-proxy/0.log" Jul 06 20:55:48.036810 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.036784 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e25d3d5-6f8e-48f2-beb8-865194cbf3ef/kube-rbac-proxy-thanos/0.log" Jul 06 20:55:48.073720 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.073644 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e25d3d5-6f8e-48f2-beb8-865194cbf3ef/init-config-reloader/0.log" Jul 06 20:55:48.120623 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.120583 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-jkbcf_1b553056-f01c-4a9f-9394-1e825601d1b7/prometheus-operator/0.log" Jul 06 20:55:48.147293 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.147260 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-jkbcf_1b553056-f01c-4a9f-9394-1e825601d1b7/kube-rbac-proxy/0.log" Jul 06 20:55:48.178003 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.177969 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-xj7pg_5752db4c-8e5d-4748-ab90-2e238161c17d/prometheus-operator-admission-webhook/0.log" Jul 06 20:55:48.209442 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.209410 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8b655f8-2tn4w_24e6acf2-7687-406b-9147-c9ccbf58c7df/telemeter-client/0.log" Jul 06 20:55:48.249100 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.249046 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8b655f8-2tn4w_24e6acf2-7687-406b-9147-c9ccbf58c7df/reload/0.log" Jul 06 20:55:48.268300 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.268274 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8b655f8-2tn4w_24e6acf2-7687-406b-9147-c9ccbf58c7df/kube-rbac-proxy/0.log" Jul 06 20:55:48.297160 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.297118 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854d5677b8-qsqcd_6246649f-4bd9-4d06-a2fb-22ab49a23322/thanos-query/0.log" Jul 06 20:55:48.318194 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.318156 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854d5677b8-qsqcd_6246649f-4bd9-4d06-a2fb-22ab49a23322/kube-rbac-proxy-web/0.log" Jul 06 20:55:48.339183 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.339112 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854d5677b8-qsqcd_6246649f-4bd9-4d06-a2fb-22ab49a23322/kube-rbac-proxy/0.log" Jul 06 20:55:48.360570 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.360526 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854d5677b8-qsqcd_6246649f-4bd9-4d06-a2fb-22ab49a23322/prom-label-proxy/0.log" Jul 06 20:55:48.382438 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.382408 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854d5677b8-qsqcd_6246649f-4bd9-4d06-a2fb-22ab49a23322/kube-rbac-proxy-rules/0.log" Jul 06 20:55:48.410299 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:48.410270 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854d5677b8-qsqcd_6246649f-4bd9-4d06-a2fb-22ab49a23322/kube-rbac-proxy-metrics/0.log" Jul 06 20:55:50.298886 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.298846 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds"] Jul 06 20:55:50.299276 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.299225 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3290165b-2237-45fd-8e75-76e820bf7da6" containerName="main" Jul 06 20:55:50.299276 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.299238 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3290165b-2237-45fd-8e75-76e820bf7da6" containerName="main" Jul 06 20:55:50.299344 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.299316 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3290165b-2237-45fd-8e75-76e820bf7da6" containerName="main" Jul 06 20:55:50.302676 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.302653 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.307195 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.307172 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hvwvn\"/\"kube-root-ca.crt\"" Jul 06 20:55:50.307337 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.307271 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hvwvn\"/\"openshift-service-ca.crt\"" Jul 06 20:55:50.308300 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.308280 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hvwvn\"/\"default-dockercfg-dk4dk\"" Jul 06 20:55:50.314394 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.314368 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds"] Jul 06 20:55:50.450661 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.450625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-sys\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.450661 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.450661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7kw5\" (UniqueName: \"kubernetes.io/projected/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-kube-api-access-q7kw5\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.450953 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.450738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-lib-modules\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.450953 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.450784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-proc\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.450953 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.450822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-podres\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.551783 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-sys\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.551783 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7kw5\" (UniqueName: \"kubernetes.io/projected/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-kube-api-access-q7kw5\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.551783 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-lib-modules\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.552024 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551796 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-proc\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.552024 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-podres\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.552024 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551829 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-sys\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.552024 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551885 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-proc\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.552024 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-lib-modules\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.552024 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.551942 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-podres\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.561416 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.561387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7kw5\" (UniqueName: \"kubernetes.io/projected/fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd-kube-api-access-q7kw5\") pod \"perf-node-gather-daemonset-ctwds\" (UID: \"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd\") " pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.614247 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.614208 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:50.757517 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:50.757476 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds"] Jul 06 20:55:50.763096 ip-10-0-136-202 kubenswrapper[2559]: W0706 20:55:50.763065 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc1ce4ff_cbd6_43b2_b4aa_f77983ce77cd.slice/crio-d051ffbd83c32d48107060f0e89f0238ef4c54576c657d682bf89aa2a0288fb8 WatchSource:0}: Error finding container d051ffbd83c32d48107060f0e89f0238ef4c54576c657d682bf89aa2a0288fb8: Status 404 returned error can't find the container with id d051ffbd83c32d48107060f0e89f0238ef4c54576c657d682bf89aa2a0288fb8 Jul 06 20:55:51.460619 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:51.460581 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" event={"ID":"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd","Type":"ContainerStarted","Data":"6e9ffd069f86e40852cddeb3d76da5f8d3391334c847da8fa06c1a5e380bc96d"} Jul 06 20:55:51.461126 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:51.460759 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:51.461126 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:51.460803 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" event={"ID":"fc1ce4ff-cbd6-43b2-b4aa-f77983ce77cd","Type":"ContainerStarted","Data":"d051ffbd83c32d48107060f0e89f0238ef4c54576c657d682bf89aa2a0288fb8"} Jul 06 20:55:51.483885 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:51.483827 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" podStartSLOduration=1.48381027 podStartE2EDuration="1.48381027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:55:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:55:51.482768046 +0000 UTC m=+2463.815755965" watchObservedRunningTime="2026-07-06 20:55:51.48381027 +0000 UTC m=+2463.816798128" Jul 06 20:55:52.607921 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:52.607893 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sr2lw_3816a3b4-5ad7-418b-86a1-403fd1c72bdc/dns/0.log" Jul 06 20:55:52.629196 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:52.629161 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sr2lw_3816a3b4-5ad7-418b-86a1-403fd1c72bdc/kube-rbac-proxy/0.log" Jul 06 20:55:52.754979 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:52.754941 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkg85_9e7b2cad-a984-4426-b072-a2eecc88de95/dns-node-resolver/0.log" Jul 06 20:55:53.337171 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:53.337115 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qpjz2_9e4458c9-0214-4543-a480-3192c30f0e18/node-ca/0.log" Jul 06 20:55:54.507639 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:54.507601 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gz744_a61d846f-6ce4-49fe-a08c-1d9a1d0b861d/discovery/0.log" Jul 06 20:55:54.531984 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:54.531951 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9c87b66f-4mpw7_d2f22ca5-3cea-411d-b593-ce87e7f45291/kube-auth-proxy/0.log" Jul 06 20:55:55.454594 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:55.454549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rwpsq_13dd9a95-6a90-4349-9cc5-fe33b8cec27a/serve-healthcheck-canary/0.log" Jul 06 20:55:55.931802 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:55.931768 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jwrj_a16de382-e7f5-40cd-b812-a42a61bdc146/kube-rbac-proxy/0.log" Jul 06 20:55:55.953866 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:55.953837 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jwrj_a16de382-e7f5-40cd-b812-a42a61bdc146/exporter/0.log" Jul 06 20:55:55.979304 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:55.979264 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jwrj_a16de382-e7f5-40cd-b812-a42a61bdc146/extractor/0.log" Jul 06 20:55:57.475429 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:57.475394 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hvwvn/perf-node-gather-daemonset-ctwds" Jul 06 20:55:58.942070 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:58.942036 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b6b7b7bb-zptlq_6cb7994e-e443-4b21-9d64-bb8a059415d4/manager/0.log" Jul 06 20:55:58.967995 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:55:58.967966 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b6b7b7bb-zptlq_6cb7994e-e443-4b21-9d64-bb8a059415d4/copy-manifests/0.log" Jul 06 20:56:00.539104 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:00.539070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86b486bf74-x5nst_f9fa96fd-32fa-423f-9532-48cc901a5ab2/manager/0.log" Jul 06 20:56:00.563696 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:00.563663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qd9p9_61bc56c7-b03a-4b16-9eda-812661e390ca/openshift-lws-operator/0.log" Jul 06 20:56:00.758871 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:00.758839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gz744_a61d846f-6ce4-49fe-a08c-1d9a1d0b861d/discovery/0.log" Jul 06 20:56:00.768662 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:00.768634 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9c87b66f-4mpw7_d2f22ca5-3cea-411d-b593-ce87e7f45291/kube-auth-proxy/0.log" Jul 06 20:56:02.272278 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:02.272239 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gz744_a61d846f-6ce4-49fe-a08c-1d9a1d0b861d/discovery/0.log" Jul 06 20:56:02.284611 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:02.284579 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f9c87b66f-4mpw7_d2f22ca5-3cea-411d-b593-ce87e7f45291/kube-auth-proxy/0.log" Jul 06 20:56:06.787052 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:06.787019 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6jn6v_f2e416e4-d89b-423e-b6dc-b7f577cb7d11/kube-multus/0.log" Jul 06 20:56:07.171394 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.171361 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrn2h_8e29849a-478b-472c-9c4f-bdc4a2eb8280/kube-multus-additional-cni-plugins/0.log" Jul 06 20:56:07.194105 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.194072 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrn2h_8e29849a-478b-472c-9c4f-bdc4a2eb8280/egress-router-binary-copy/0.log" Jul 06 20:56:07.214359 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.214335 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrn2h_8e29849a-478b-472c-9c4f-bdc4a2eb8280/cni-plugins/0.log" Jul 06 20:56:07.235254 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.235226 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrn2h_8e29849a-478b-472c-9c4f-bdc4a2eb8280/bond-cni-plugin/0.log" Jul 06 20:56:07.256462 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.256431 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrn2h_8e29849a-478b-472c-9c4f-bdc4a2eb8280/routeoverride-cni/0.log" Jul 06 20:56:07.280636 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.280607 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrn2h_8e29849a-478b-472c-9c4f-bdc4a2eb8280/whereabouts-cni-bincopy/0.log" Jul 06 20:56:07.305203 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.305173 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrn2h_8e29849a-478b-472c-9c4f-bdc4a2eb8280/whereabouts-cni/0.log" Jul 06 20:56:07.415858 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.415830 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4448z_85d46691-3809-443c-8a0c-b955a8de3992/network-metrics-daemon/0.log" Jul 06 20:56:07.436024 ip-10-0-136-202 kubenswrapper[2559]: I0706 20:56:07.435945 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4448z_85d46691-3809-443c-8a0c-b955a8de3992/kube-rbac-proxy/0.log"