Jul 06 19:03:18.553210 ip-10-0-142-233 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 19:03:18.553222 ip-10-0-142-233 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 19:03:18.553230 ip-10-0-142-233 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 19:03:18.553544 ip-10-0-142-233 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 19:03:28.792604 ip-10-0-142-233 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 19:03:28.792625 ip-10-0-142-233 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 778d1025fed54bd382497af64eb0041a -- Jul 06 19:05:23.795750 ip-10-0-142-233 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:05:24.431114 ip-10-0-142-233 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:05:24.431114 ip-10-0-142-233 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:05:24.431114 ip-10-0-142-233 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:05:24.431114 ip-10-0-142-233 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:05:24.431114 ip-10-0-142-233 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:05:24.431114 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.430642 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:05:24.525070 ip-10-0-142-233 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435850 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435866 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435871 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435876 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435880 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435884 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435889 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435893 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435897 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435901 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435905 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435910 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435914 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435918 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435922 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435926 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435931 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435936 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435942 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:24.531951 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435946 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435950 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435954 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435957 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435961 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435965 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435970 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435974 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435978 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435983 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435986 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435990 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.435996 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436001 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436006 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436011 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436016 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436020 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436024 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:24.533624 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436028 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436032 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436036 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436039 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436049 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436054 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436058 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436062 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436066 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436069 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436074 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436078 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436082 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436088 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436093 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436097 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436101 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436105 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436109 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:24.534415 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436113 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436117 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436120 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436124 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436128 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436134 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436138 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436142 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436145 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436149 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436152 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436156 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436159 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436163 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436167 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436171 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436174 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436178 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436196 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436201 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:24.535196 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436205 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436209 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436214 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436218 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436222 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436226 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436229 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436233 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436238 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436241 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436245 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436249 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436253 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436256 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436260 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436264 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436268 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436272 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436275 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436279 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:24.535946 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436282 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.436286 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446289 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446302 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446305 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446308 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446311 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446314 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446317 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446320 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446322 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446325 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446327 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446330 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446333 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446335 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446338 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446341 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446343 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446346 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:24.536592 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446348 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446351 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446354 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446357 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446361 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446364 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446367 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446370 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446372 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446374 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446377 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446380 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446382 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446385 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446387 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446390 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446392 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446395 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446398 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446400 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:24.539094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446403 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446405 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446408 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446410 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446413 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446416 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446419 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446421 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446423 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446426 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446429 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446431 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446434 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446437 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446440 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446443 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446446 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446448 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446450 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446453 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:24.540478 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446456 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446458 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446479 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446483 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446490 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446496 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446500 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446503 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446506 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446508 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446511 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446513 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446516 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446519 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446522 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446524 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446527 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446530 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446532 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:24.542804 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446535 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446539 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446543 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446546 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446549 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446551 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446561 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446565 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446568 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446571 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446573 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446576 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446579 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446581 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446584 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446586 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446589 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446591 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446594 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:24.544222 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446596 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446599 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.446602 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447025 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447030 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447033 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447036 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447039 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447043 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447047 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447050 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447053 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447056 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447059 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447063 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447066 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447069 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447072 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447074 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:24.546370 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447083 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447086 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447089 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447092 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447094 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447097 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447100 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447103 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447106 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447108 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447111 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447113 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447116 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447118 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447121 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447123 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447126 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447129 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447131 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447134 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:24.547766 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447136 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447139 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447141 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447144 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447147 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447150 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447152 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447155 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447158 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447161 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447163 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447169 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447171 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447184 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447187 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447190 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447192 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447195 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447197 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447200 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:24.548921 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447202 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447205 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447208 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447210 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447213 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447217 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447220 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447222 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447225 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447228 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447231 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447233 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447236 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447239 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447242 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447245 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447249 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447252 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447254 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447257 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:24.550311 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447259 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447262 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447265 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447271 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447274 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447277 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447285 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447288 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447291 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447293 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447295 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447298 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447300 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447303 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447305 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447308 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447311 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447313 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447315 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447318 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:24.551877 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447320 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447322 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.447325 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447397 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447404 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447420 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447424 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447429 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447433 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447437 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447442 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447445 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447448 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447451 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447454 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447459 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447475 2581 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447478 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447481 2581 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447497 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447500 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447508 2581 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447511 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:05:24.552785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447514 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447517 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447521 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447524 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447527 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447530 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447533 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447536 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447539 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447542 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447545 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447548 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447553 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447556 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447559 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447562 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447564 2581 flags.go:64] FLAG: --enable-server="true" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447569 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447576 2581 flags.go:64] FLAG: --event-burst="100" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447579 2581 flags.go:64] FLAG: --event-qps="50" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447582 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447584 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447587 2581 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447591 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:05:24.554108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447595 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447598 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447601 2581 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447604 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447608 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447616 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447619 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447622 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447625 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447628 2581 flags.go:64] FLAG: --feature-gates="" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447632 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447635 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447638 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447641 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447644 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447646 2581 flags.go:64] FLAG: --help="false" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447649 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-233.ec2.internal" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447652 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447655 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447658 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447661 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447665 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447667 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:05:24.555252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447670 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447673 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447677 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447680 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447683 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447686 2581 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447689 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447692 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447694 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447698 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447701 2581 flags.go:64] FLAG: --lock-file="" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447704 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447707 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447710 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447715 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447724 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447727 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447730 2581 flags.go:64] FLAG: --logging-format="text" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447732 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447735 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447738 2581 flags.go:64] FLAG: --manifest-url="" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447741 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447745 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447748 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447752 2581 flags.go:64] FLAG: --max-pods="110" Jul 06 19:05:24.556188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447755 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447758 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447761 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447764 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447767 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447770 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447772 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447780 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447783 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447787 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447790 2581 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447793 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447799 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447801 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447804 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447807 2581 flags.go:64] FLAG: --port="10250" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447810 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447815 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-088579ba5c9754a94" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447818 2581 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447821 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447824 2581 flags.go:64] FLAG: --register-node="true" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447827 2581 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447830 2581 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447839 2581 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:05:24.557043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447842 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447845 2581 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447849 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447852 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447854 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447857 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447860 2581 flags.go:64] FLAG: --runonce="false" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447863 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447866 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447868 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447871 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447874 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447877 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447880 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447883 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447886 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447888 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447892 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447895 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447898 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447901 2581 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447904 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447909 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447912 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447915 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:05:24.557853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447922 2581 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447925 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447928 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447931 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447934 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447937 2581 flags.go:64] FLAG: --v="2" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447945 2581 flags.go:64] FLAG: --version="false" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447955 2581 flags.go:64] FLAG: --vmodule="" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447958 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.447961 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448104 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448108 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448111 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448114 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448118 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448121 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448124 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448127 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448130 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448133 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448135 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:24.558686 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448138 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448140 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448143 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448147 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448149 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448152 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448155 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448157 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448160 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448163 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448165 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448170 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448172 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448175 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448177 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448181 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448183 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448193 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448196 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448205 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:24.559968 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448208 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448211 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448213 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448216 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448218 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448221 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448224 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448226 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448229 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448231 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448234 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448236 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448240 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448243 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448246 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448250 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448253 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448256 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448259 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:24.560709 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448261 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448264 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448266 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448269 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448273 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448275 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448278 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448280 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448283 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448286 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448288 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448290 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448293 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448301 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448304 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448307 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448310 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448312 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448315 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448317 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:24.804614 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448320 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448322 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448325 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448327 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448330 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448332 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448336 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448339 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448343 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448346 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448348 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448351 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448353 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448356 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448358 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448361 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448365 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448367 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448370 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448372 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:24.866514 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448375 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448378 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448380 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448383 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448386 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448388 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448396 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448399 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.448401 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.448936 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.467505 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.467523 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.469060 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.469069 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469129 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:24.868114 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469135 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469139 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469144 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469149 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469152 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469155 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469158 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469160 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469163 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469166 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469169 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469172 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469175 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469177 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469180 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469182 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469185 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469188 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469190 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:24.868958 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469193 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469195 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469198 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469200 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469203 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469206 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469209 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469211 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469214 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469218 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469220 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469223 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469225 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469228 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469230 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469233 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469237 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469240 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469243 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:24.869799 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469246 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469248 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469251 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469254 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469256 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469259 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469262 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469265 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469267 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469270 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469273 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469275 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469278 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469280 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469283 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469286 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469288 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469290 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469296 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:24.870441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469298 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469301 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469303 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469306 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469309 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469312 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469315 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469318 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469320 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469323 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469325 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469328 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469335 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469338 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469340 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469343 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469345 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469348 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469351 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469354 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:24.871119 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469357 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469359 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469362 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469365 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469367 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469371 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469375 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469378 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469380 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469383 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469385 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469389 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469391 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469395 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469397 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469400 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469402 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469410 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469413 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469415 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:24.871938 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469418 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.469423 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469559 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469565 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469570 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469573 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469576 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469578 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469581 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469584 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469587 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469590 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469592 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469595 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469597 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:05:24.872652 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469600 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469602 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469605 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469607 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469610 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469613 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469615 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469618 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469620 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469624 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469627 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469629 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469632 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469634 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469638 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469641 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469643 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469646 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469648 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:05:24.873162 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469652 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469656 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469660 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469662 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469665 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469667 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469670 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469672 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469675 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469677 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469680 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469682 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469685 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469687 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469690 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469692 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469697 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469700 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469702 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469705 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:05:24.873785 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469708 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469710 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469714 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469717 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469719 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469722 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469724 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469727 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469730 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469733 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469735 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469737 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469740 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469743 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469746 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469749 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469751 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469754 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469756 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469759 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:05:24.874441 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469761 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469764 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469766 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469769 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469773 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469776 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469779 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469782 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469785 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469787 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469790 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469792 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469795 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469798 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469802 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469805 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469807 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469810 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469812 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:05:24.875154 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469815 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469817 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469820 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469823 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469825 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469828 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469830 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:24.469835 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.469840 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.470000 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.472258 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.473603 2581 server.go:1019] "Starting client certificate rotation" Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.473705 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.473808 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:05:24.875806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.476475 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:05:24.876286 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.478402 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:05:24.876286 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.491190 2581 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:05:24.876286 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.493561 2581 log.go:25] "Validated CRI v1 image API" Jul 06 19:05:24.876286 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.494427 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:05:24.876286 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.497192 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a549b39f-4024-4a04-a335-a96ed2cc4d56:/dev/nvme0n1p3 e1999d68-3d36-4074-ac75-dd6958a1e2e8:/dev/nvme0n1p4] Jul 06 19:05:24.876286 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.497208 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.503753 2581 manager.go:216] Machine: {Timestamp:2026-07-06 19:05:24.502206465 +0000 UTC m=+0.591530615 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100406 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29714cae650366ae34bb8f4724544e SystemUUID:ec29714c-ae65-0366-ae34-bb8f4724544e BootID:778d1025-fed5-4bd3-8249-7af64eb0041a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2c:c1:fa:5a:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2c:c1:fa:5a:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:fb:5c:2e:44:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.503867 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.503950 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.505020 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.505051 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.505899 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.505911 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.505919 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.506510 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.507895 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.512835 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.512966 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.513000 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.513012 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.513028 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.513038 2581 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.513047 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:05:24.876692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.513430 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.513446 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.514063 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.515778 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.517795 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.517824 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519667 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519681 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519687 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519693 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519703 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519711 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519725 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519731 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519738 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519744 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519762 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.519768 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.520605 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.520614 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.524138 2581 server.go:1268] "Started kubelet" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.524218 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.524324 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.524402 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.527416 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.532197 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.531696 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.532979 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.532175 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-233.ec2.internal.18bfc8c4ae38b4e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-233.ec2.internal,UID:ip-10-0-142-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-233.ec2.internal,},FirstTimestamp:2026-07-06 19:05:24.524102889 +0000 UTC m=+0.613427040,LastTimestamp:2026-07-06 19:05:24.524102889 +0000 UTC m=+0.613427040,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-233.ec2.internal,}" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.538618 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.538623 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.538716 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539261 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539264 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539288 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539440 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539451 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539726 2581 factory.go:55] Registering systemd factory Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539743 2581 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539970 2581 factory.go:153] Registering CRI-O factory Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.539983 2581 factory.go:223] Registration of the crio container factory successfully Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.540058 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.540086 2581 factory.go:103] Registering Raw factory Jul 06 19:05:24.877374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.540102 2581 manager.go:1196] Started watching for new ooms in manager Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.540526 2581 manager.go:349] Starting recovery of all containers Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.541222 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.541366 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.545830 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.545889 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.552183 2581 manager.go:354] Recovery completed Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.557101 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.559130 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.559178 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.559200 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.559898 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.559911 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.559931 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.560249 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.561574 2581 policy_none.go:49] "None policy: Start" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.561594 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.561610 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.562251 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.562271 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.562280 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.562272 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-233.ec2.internal.18bfc8c4b04fa7c1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-233.ec2.internal,UID:ip-10-0-142-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-233.ec2.internal,},FirstTimestamp:2026-07-06 19:05:24.559161281 +0000 UTC m=+0.648485434,LastTimestamp:2026-07-06 19:05:24.559161281 +0000 UTC m=+0.648485434,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-233.ec2.internal,}" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.563238 2581 policy_none.go:47] "Start" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.568943 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wmzl5" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.574617 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-233.ec2.internal.18bfc8c4b050119c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-233.ec2.internal,UID:ip-10-0-142-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-233.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-233.ec2.internal,},FirstTimestamp:2026-07-06 19:05:24.55918838 +0000 UTC m=+0.648512533,LastTimestamp:2026-07-06 19:05:24.55918838 +0000 UTC m=+0.648512533,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-233.ec2.internal,}" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.578974 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wmzl5" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.591578 2581 manager.go:337] "Starting Device Plugin manager" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.591620 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.591633 2581 server.go:87] "Starting device plugin registration server" Jul 06 19:05:24.878726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.591896 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.591908 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.592233 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.592299 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.592308 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.592940 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.593000 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.693891 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.695147 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.695181 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.695197 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.695229 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-233.ec2.internal" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.706302 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-233.ec2.internal" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.706335 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-233.ec2.internal\": node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.708841 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.710125 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.710163 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.710190 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.710224 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.712785 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.740103 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.812843 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal"] Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.812945 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.814021 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.814058 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.814075 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.819360 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.819499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.819532 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.820230 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.820249 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.820259 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.820516 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.820530 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.820559 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.826218 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.826244 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.827088 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.827119 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.827135 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.839151 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-233.ec2.internal\" not found" node="ip-10-0-142-233.ec2.internal" Jul 06 19:05:24.879704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.840162 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:24.880901 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.844029 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-233.ec2.internal\" not found" node="ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:24.940408 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.940492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61e1c42ac9a08ecfb3c8cc5e93139196-config\") pod \"kube-apiserver-proxy-ip-10-0-142-233.ec2.internal\" (UID: \"61e1c42ac9a08ecfb3c8cc5e93139196\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.940518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:24.940543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.041147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61e1c42ac9a08ecfb3c8cc5e93139196-config\") pod \"kube-apiserver-proxy-ip-10-0-142-233.ec2.internal\" (UID: \"61e1c42ac9a08ecfb3c8cc5e93139196\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.041201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.041225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.041268 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61e1c42ac9a08ecfb3c8cc5e93139196-config\") pod \"kube-apiserver-proxy-ip-10-0-142-233.ec2.internal\" (UID: \"61e1c42ac9a08ecfb3c8cc5e93139196\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.041285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.041275 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.041335 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.144522 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.144585 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.162606 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.147282 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:25.354265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.245615 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:25.354265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.346544 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:25.598036 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.447616 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:25.598036 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.474693 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:05:25.598036 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.474972 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:05:25.598036 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.547786 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:25.598036 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.583906 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:00:25 +0000 UTC" deadline="2028-03-21 02:52:01.563878858 +0000 UTC" Jul 06 19:05:25.598036 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.583937 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14959h46m35.979945653s" Jul 06 19:05:25.791104 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.642920 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:05:25.791104 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.644186 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:05:25.791104 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.644219 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:05:25.791104 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.644230 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:05:25.791104 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.648411 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:25.791104 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.664302 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:25.791104 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.749435 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:26.031015 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:25.828145 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e1c42ac9a08ecfb3c8cc5e93139196.slice/crio-6171cee0459cb4b2edd3c20fc47da3d79e582ce66309722929545f14c2eae801 WatchSource:0}: Error finding container 6171cee0459cb4b2edd3c20fc47da3d79e582ce66309722929545f14c2eae801: Status 404 returned error can't find the container with id 6171cee0459cb4b2edd3c20fc47da3d79e582ce66309722929545f14c2eae801 Jul 06 19:05:26.031015 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:25.828503 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d20294c54eebf1cdd45bd4f32b1e5e.slice/crio-e1c621d403af45e489e9bcd2fe62ad861238bd5db015bd7665885eb953164f0d WatchSource:0}: Error finding container e1c621d403af45e489e9bcd2fe62ad861238bd5db015bd7665885eb953164f0d: Status 404 returned error can't find the container with id e1c621d403af45e489e9bcd2fe62ad861238bd5db015bd7665885eb953164f0d Jul 06 19:05:26.031015 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.833669 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:05:26.031015 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.849947 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:26.031015 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:25.950043 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 06 19:05:26.031015 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.955091 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:26.031015 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:25.984811 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:26.279210 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.040122 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 06 19:05:26.279210 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.055943 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:05:26.279210 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.056997 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 06 19:05:26.279210 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.071633 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.515352 2581 apiserver.go:52] "Watching apiserver" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.525724 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.526949 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-x8mk4","openshift-multus/multus-mhkpd","openshift-network-operator/iptables-alerter-v459d","kube-system/global-pull-secret-syncer-hfdw8","kube-system/konnectivity-agent-2g65w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk","openshift-dns/node-resolver-h5kp8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal","openshift-multus/network-metrics-daemon-vbkcv","openshift-network-diagnostics/network-check-target-nsqkr","openshift-ovn-kubernetes/ovnkube-node-44c4t","kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gjwk7","openshift-image-registry/node-ca-5z2tp"] Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.528533 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.528597 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.529806 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.530995 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.532298 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.532817 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.534301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.534424 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.534660 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.534740 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.534804 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-75b77\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.535056 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.535247 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.535345 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.535533 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q6kbs\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.535594 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4n9pt\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.535719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.536273 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.537010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.537080 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.538289 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.539382 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.539592 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tb57k\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.539686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.539916 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.540115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.541167 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.542990 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.564100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.544373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.544424 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.544850 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.544892 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.545141 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.545143 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h2c44\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.545147 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.546967 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.547062 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.547132 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fgpct\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.548469 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.548625 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.549506 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.549512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ws5pk\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.549549 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.550432 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5lg\" (UniqueName: \"kubernetes.io/projected/b13928a4-8ea4-4208-b577-30710d00a7bd-kube-api-access-vq5lg\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-k8s-cni-cncf-io\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-netns\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-multus-certs\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8645\" (UniqueName: \"kubernetes.io/projected/baa7615f-56ab-4259-8724-8ce7275ab5e4-kube-api-access-r8645\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-modprobe-d\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553630 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-system-cni-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-cni-bin\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-conf-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.567702 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysctl-d\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553723 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-run\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-sys\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553851 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-lib-modules\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ff70497-3f0b-42f8-8b10-481b7d048726-tmp\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-os-release\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-kubelet\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.553991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysconfig\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-kubernetes\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-systemd\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-host\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/219aa01a-8349-48e1-a36c-d05e3c5ea7a8-agent-certs\") pod \"konnectivity-agent-2g65w\" (UID: \"219aa01a-8349-48e1-a36c-d05e3c5ea7a8\") " pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b47e306-065b-46d6-820f-70017f7d8bbe-iptables-alerter-script\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f137841-b4b0-4311-9473-a155a6f320fe-hosts-file\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.568806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysctl-conf\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/219aa01a-8349-48e1-a36c-d05e3c5ea7a8-konnectivity-ca\") pod \"konnectivity-agent-2g65w\" (UID: \"219aa01a-8349-48e1-a36c-d05e3c5ea7a8\") " pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554281 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kjt8\" (UniqueName: \"kubernetes.io/projected/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-kube-api-access-7kjt8\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-serviceca\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-cnibin\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-hostroot\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-etc-kubernetes\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-device-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554580 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5cx5\"" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-etc-selinux\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554621 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bjkqn\"" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554635 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-sys-fs\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-host\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-daemon-config\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-socket-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.569529 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-registration-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-tuned\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b47e306-065b-46d6-820f-70017f7d8bbe-host-slash\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554910 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6fbb\" (UniqueName: \"kubernetes.io/projected/3b47e306-065b-46d6-820f-70017f7d8bbe-kube-api-access-x6fbb\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.554973 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgcnq\" (UniqueName: \"kubernetes.io/projected/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-kube-api-access-hgcnq\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555051 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-var-lib-kubelet\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpwgk\" (UniqueName: \"kubernetes.io/projected/7ff70497-3f0b-42f8-8b10-481b7d048726-kube-api-access-qpwgk\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f137841-b4b0-4311-9473-a155a6f320fe-tmp-dir\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcm5\" (UniqueName: \"kubernetes.io/projected/5f137841-b4b0-4311-9473-a155a6f320fe-kube-api-access-gqcm5\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-cni-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baa7615f-56ab-4259-8724-8ce7275ab5e4-cni-binary-copy\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-socket-dir-parent\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.555263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-cni-multus\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.570392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.570202 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:05:26.584434 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.584403 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:05:26.585522 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.585498 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7zkn" Jul 06 19:05:26.598041 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.598014 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7zkn" Jul 06 19:05:26.641406 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.641384 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:05:26.655534 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-etc-kubernetes\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.655534 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655525 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-etc-kubernetes\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-cni-netd\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-sys-fs\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-host\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-daemon-config\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-run-ovn-kubernetes\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-cni-bin\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655744 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-host\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-tuned\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6fbb\" (UniqueName: \"kubernetes.io/projected/3b47e306-065b-46d6-820f-70017f7d8bbe-kube-api-access-x6fbb\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.655711 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-sys-fs\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656116 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656404 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-daemon-config\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656465 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f137841-b4b0-4311-9473-a155a6f320fe-tmp-dir\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f137841-b4b0-4311-9473-a155a6f320fe-tmp-dir\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcm5\" (UniqueName: \"kubernetes.io/projected/5f137841-b4b0-4311-9473-a155a6f320fe-kube-api-access-gqcm5\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-cni-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baa7615f-56ab-4259-8724-8ce7275ab5e4-cni-binary-copy\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.658725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-conf-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-var-lib-kubelet\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-socket-dir-parent\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-multus-certs\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cnibin\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-etc-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-ovn\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656868 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-var-lib-kubelet\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-ovnkube-config\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656891 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-conf-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5lg\" (UniqueName: \"kubernetes.io/projected/b13928a4-8ea4-4208-b577-30710d00a7bd-kube-api-access-vq5lg\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.656962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-k8s-cni-cncf-io\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-multus-certs\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657074 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-cni-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-systemd\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.659714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8426f194-af92-433c-b71d-50b6d56fcd23-kubelet-config\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657138 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-multus-socket-dir-parent\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-cni-bin\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657242 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-k8s-cni-cncf-io\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657249 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-cni-bin\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-systemd-units\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657313 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baa7615f-56ab-4259-8724-8ce7275ab5e4-cni-binary-copy\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-env-overrides\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-ovnkube-script-lib\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysctl-d\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-lib-modules\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-os-release\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-kubelet\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b47e306-065b-46d6-820f-70017f7d8bbe-iptables-alerter-script\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-hostroot\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.660570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657620 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-os-release\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657627 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgtts\" (UniqueName: \"kubernetes.io/projected/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-kube-api-access-rgtts\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657636 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-lib-modules\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cdf8509-3a00-466d-9021-7b1929a9e147-ovn-node-metrics-cert\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657597 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysctl-d\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657677 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-hostroot\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657678 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-kubelet\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/219aa01a-8349-48e1-a36c-d05e3c5ea7a8-konnectivity-ca\") pod \"konnectivity-agent-2g65w\" (UID: \"219aa01a-8349-48e1-a36c-d05e3c5ea7a8\") " pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kjt8\" (UniqueName: \"kubernetes.io/projected/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-kube-api-access-7kjt8\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-serviceca\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-slash\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-device-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-etc-selinux\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-run-netns\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-node-log\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.661420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657964 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfjlk\" (UniqueName: \"kubernetes.io/projected/4cdf8509-3a00-466d-9021-7b1929a9e147-kube-api-access-tfjlk\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.657991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-socket-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658152 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-socket-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658184 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b47e306-065b-46d6-820f-70017f7d8bbe-iptables-alerter-script\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658225 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658280 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-device-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-serviceca\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-registration-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b47e306-065b-46d6-820f-70017f7d8bbe-host-slash\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658414 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-etc-selinux\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcnq\" (UniqueName: \"kubernetes.io/projected/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-kube-api-access-hgcnq\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/219aa01a-8349-48e1-a36c-d05e3c5ea7a8-konnectivity-ca\") pod \"konnectivity-agent-2g65w\" (UID: \"219aa01a-8349-48e1-a36c-d05e3c5ea7a8\") " pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-cni-multus\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658522 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-registration-dir\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-os-release\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658569 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b47e306-065b-46d6-820f-70017f7d8bbe-host-slash\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpwgk\" (UniqueName: \"kubernetes.io/projected/7ff70497-3f0b-42f8-8b10-481b7d048726-kube-api-access-qpwgk\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.662287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-system-cni-dir\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658666 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-var-lib-cni-multus\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658747 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-kubelet\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-var-lib-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-netns\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8645\" (UniqueName: \"kubernetes.io/projected/baa7615f-56ab-4259-8724-8ce7275ab5e4-kube-api-access-r8645\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658862 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-host-run-netns\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.658891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-log-socket\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-modprobe-d\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-system-cni-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-run\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-run\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659145 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-modprobe-d\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659157 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-system-cni-dir\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-sys\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ff70497-3f0b-42f8-8b10-481b7d048726-tmp\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-sys\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8426f194-af92-433c-b71d-50b6d56fcd23-dbus\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysconfig\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-kubernetes\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-systemd\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-host\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659409 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysconfig\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659459 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-kubernetes\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/219aa01a-8349-48e1-a36c-d05e3c5ea7a8-agent-certs\") pod \"konnectivity-agent-2g65w\" (UID: \"219aa01a-8349-48e1-a36c-d05e3c5ea7a8\") " pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659500 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-host\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f137841-b4b0-4311-9473-a155a6f320fe-hosts-file\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659556 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-systemd\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysctl-conf\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659608 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f137841-b4b0-4311-9473-a155a6f320fe-hosts-file\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.659623 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:26.663768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-cnibin\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.664704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.659697 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:27.159675099 +0000 UTC m=+3.248999254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:26.664704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-sysctl-conf\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.664704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.659744 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baa7615f-56ab-4259-8724-8ce7275ab5e4-cnibin\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.664704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.661435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ff70497-3f0b-42f8-8b10-481b7d048726-etc-tuned\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.664704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.662763 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/219aa01a-8349-48e1-a36c-d05e3c5ea7a8-agent-certs\") pod \"konnectivity-agent-2g65w\" (UID: \"219aa01a-8349-48e1-a36c-d05e3c5ea7a8\") " pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:26.664704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.662773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ff70497-3f0b-42f8-8b10-481b7d048726-tmp\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.676547 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.676520 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:26.676669 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.676552 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:26.676669 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.676567 2581 projected.go:196] Error preparing data for projected volume kube-api-access-rg92x for pod openshift-network-diagnostics/network-check-target-nsqkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:26.676669 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.676643 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x podName:f79fbb9b-a58e-431d-9718-15aa3ee64709 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:27.176622543 +0000 UTC m=+3.265946695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rg92x" (UniqueName: "kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x") pod "network-check-target-nsqkr" (UID: "f79fbb9b-a58e-431d-9718-15aa3ee64709") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:26.677228 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.677200 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6fbb\" (UniqueName: \"kubernetes.io/projected/3b47e306-065b-46d6-820f-70017f7d8bbe-kube-api-access-x6fbb\") pod \"iptables-alerter-v459d\" (UID: \"3b47e306-065b-46d6-820f-70017f7d8bbe\") " pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.678761 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.678714 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgcnq\" (UniqueName: \"kubernetes.io/projected/5efa33d4-4aab-46fb-a9e1-687e3d4b07ef-kube-api-access-hgcnq\") pod \"node-ca-5z2tp\" (UID: \"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef\") " pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.679203 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.679179 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcm5\" (UniqueName: \"kubernetes.io/projected/5f137841-b4b0-4311-9473-a155a6f320fe-kube-api-access-gqcm5\") pod \"node-resolver-h5kp8\" (UID: \"5f137841-b4b0-4311-9473-a155a6f320fe\") " pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.680757 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.680726 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8645\" (UniqueName: \"kubernetes.io/projected/baa7615f-56ab-4259-8724-8ce7275ab5e4-kube-api-access-r8645\") pod \"multus-mhkpd\" (UID: \"baa7615f-56ab-4259-8724-8ce7275ab5e4\") " pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.682579 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.682493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5lg\" (UniqueName: \"kubernetes.io/projected/b13928a4-8ea4-4208-b577-30710d00a7bd-kube-api-access-vq5lg\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:26.685057 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.685034 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpwgk\" (UniqueName: \"kubernetes.io/projected/7ff70497-3f0b-42f8-8b10-481b7d048726-kube-api-access-qpwgk\") pod \"tuned-gjwk7\" (UID: \"7ff70497-3f0b-42f8-8b10-481b7d048726\") " pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.686632 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.686585 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kjt8\" (UniqueName: \"kubernetes.io/projected/8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c-kube-api-access-7kjt8\") pod \"aws-ebs-csi-driver-node-58kwk\" (UID: \"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.719120 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.718968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" event={"ID":"61e1c42ac9a08ecfb3c8cc5e93139196","Type":"ContainerStarted","Data":"6171cee0459cb4b2edd3c20fc47da3d79e582ce66309722929545f14c2eae801"} Jul 06 19:05:26.721799 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.721763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" event={"ID":"d3d20294c54eebf1cdd45bd4f32b1e5e","Type":"ContainerStarted","Data":"e1c621d403af45e489e9bcd2fe62ad861238bd5db015bd7665885eb953164f0d"} Jul 06 19:05:26.759961 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.759923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgtts\" (UniqueName: \"kubernetes.io/projected/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-kube-api-access-rgtts\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.760156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.759973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cdf8509-3a00-466d-9021-7b1929a9e147-ovn-node-metrics-cert\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-slash\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-run-netns\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-node-log\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfjlk\" (UniqueName: \"kubernetes.io/projected/4cdf8509-3a00-466d-9021-7b1929a9e147-kube-api-access-tfjlk\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-os-release\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-system-cni-dir\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-kubelet\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-var-lib-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-log-socket\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8426f194-af92-433c-b71d-50b6d56fcd23-dbus\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-cni-netd\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-run-ovn-kubernetes\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-cni-bin\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.760515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cnibin\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-etc-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-ovn\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-ovnkube-config\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-systemd\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760671 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-kubelet\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8426f194-af92-433c-b71d-50b6d56fcd23-kubelet-config\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-systemd-units\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-env-overrides\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.760826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-ovnkube-script-lib\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761765 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.761577 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-ovnkube-script-lib\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761765 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.761654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-var-lib-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761765 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.761700 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-log-socket\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761923 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.761776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-slash\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761923 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.761821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-run-netns\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761923 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.761858 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.761923 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.761896 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-node-log\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.762217 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-os-release\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.762272 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-run-ovn-kubernetes\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.762272 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762264 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8426f194-af92-433c-b71d-50b6d56fcd23-dbus\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.762378 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762309 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-system-cni-dir\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.762378 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762320 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-cni-bin\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.762378 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-cni-netd\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.762555 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cnibin\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.762555 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-etc-openvswitch\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.762555 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-ovn\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.762555 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762529 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.762835 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762806 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.762892 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762204 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.762955 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.762938 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:26.763012 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.762987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-ovnkube-config\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.763074 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:26.763021 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret podName:8426f194-af92-433c-b71d-50b6d56fcd23 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:27.263001412 +0000 UTC m=+3.352325563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret") pod "global-pull-secret-syncer-hfdw8" (UID: "8426f194-af92-433c-b71d-50b6d56fcd23") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:26.763143 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.763127 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.763199 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.763180 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-systemd-units\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.763498 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.763477 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.763588 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.763528 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4cdf8509-3a00-466d-9021-7b1929a9e147-env-overrides\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.763588 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.763562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4cdf8509-3a00-466d-9021-7b1929a9e147-run-systemd\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.763705 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.763607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8426f194-af92-433c-b71d-50b6d56fcd23-kubelet-config\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:26.764565 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.764538 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cdf8509-3a00-466d-9021-7b1929a9e147-ovn-node-metrics-cert\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.782630 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.782593 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfjlk\" (UniqueName: \"kubernetes.io/projected/4cdf8509-3a00-466d-9021-7b1929a9e147-kube-api-access-tfjlk\") pod \"ovnkube-node-44c4t\" (UID: \"4cdf8509-3a00-466d-9021-7b1929a9e147\") " pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.786242 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.786206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgtts\" (UniqueName: \"kubernetes.io/projected/2ad84f6f-5817-451d-98a0-e06dfdab6f9d-kube-api-access-rgtts\") pod \"multus-additional-cni-plugins-x8mk4\" (UID: \"2ad84f6f-5817-451d-98a0-e06dfdab6f9d\") " pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.843382 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.843196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" Jul 06 19:05:26.852079 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.852052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:26.855997 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:26.855963 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff70497_3f0b_42f8_8b10_481b7d048726.slice/crio-d7adb9adf49149fefcdaa9a749e1c71bf563efebb7e25060e42ef41934a3531a WatchSource:0}: Error finding container d7adb9adf49149fefcdaa9a749e1c71bf563efebb7e25060e42ef41934a3531a: Status 404 returned error can't find the container with id d7adb9adf49149fefcdaa9a749e1c71bf563efebb7e25060e42ef41934a3531a Jul 06 19:05:26.865027 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:26.864998 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219aa01a_8349_48e1_a36c_d05e3c5ea7a8.slice/crio-04df450baf7311b53f4bd3ec975d78f907339f3117bc787d2a7b54b50ab1acb2 WatchSource:0}: Error finding container 04df450baf7311b53f4bd3ec975d78f907339f3117bc787d2a7b54b50ab1acb2: Status 404 returned error can't find the container with id 04df450baf7311b53f4bd3ec975d78f907339f3117bc787d2a7b54b50ab1acb2 Jul 06 19:05:26.895563 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.894626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v459d" Jul 06 19:05:26.901749 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.901716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5z2tp" Jul 06 19:05:26.909755 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:26.909701 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b47e306_065b_46d6_820f_70017f7d8bbe.slice/crio-6115e0d8c072b702638af615bba8f3dea6a7ec4c31a4e4429b223c3a7986ce0c WatchSource:0}: Error finding container 6115e0d8c072b702638af615bba8f3dea6a7ec4c31a4e4429b223c3a7986ce0c: Status 404 returned error can't find the container with id 6115e0d8c072b702638af615bba8f3dea6a7ec4c31a4e4429b223c3a7986ce0c Jul 06 19:05:26.912128 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.912021 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" Jul 06 19:05:26.921602 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.921579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h5kp8" Jul 06 19:05:26.930743 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.930717 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhkpd" Jul 06 19:05:26.932629 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:26.932600 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f137841_b4b0_4311_9473_a155a6f320fe.slice/crio-f04e2fa82c98300813ab6de20c4f916e8aedd8ada6cb699526249dae668ecf94 WatchSource:0}: Error finding container f04e2fa82c98300813ab6de20c4f916e8aedd8ada6cb699526249dae668ecf94: Status 404 returned error can't find the container with id f04e2fa82c98300813ab6de20c4f916e8aedd8ada6cb699526249dae668ecf94 Jul 06 19:05:26.939097 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.938917 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" Jul 06 19:05:26.944990 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:26.944955 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa7615f_56ab_4259_8724_8ce7275ab5e4.slice/crio-70589a3526e93e33f65676b168dcba70fe39866e96e1e4325b10afe601051aa8 WatchSource:0}: Error finding container 70589a3526e93e33f65676b168dcba70fe39866e96e1e4325b10afe601051aa8: Status 404 returned error can't find the container with id 70589a3526e93e33f65676b168dcba70fe39866e96e1e4325b10afe601051aa8 Jul 06 19:05:26.946117 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:26.946096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:26.957087 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:26.954602 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad84f6f_5817_451d_98a0_e06dfdab6f9d.slice/crio-6b69dfa55ce2fb55b3fdd233464a44a7cba4982d71fcacef566e4c4da42bf3df WatchSource:0}: Error finding container 6b69dfa55ce2fb55b3fdd233464a44a7cba4982d71fcacef566e4c4da42bf3df: Status 404 returned error can't find the container with id 6b69dfa55ce2fb55b3fdd233464a44a7cba4982d71fcacef566e4c4da42bf3df Jul 06 19:05:26.958701 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:05:26.958660 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdf8509_3a00_466d_9021_7b1929a9e147.slice/crio-7273d768b6853d69e7db60e1f06266638df2add7b647b143a3b5ee8e6b27ea1c WatchSource:0}: Error finding container 7273d768b6853d69e7db60e1f06266638df2add7b647b143a3b5ee8e6b27ea1c: Status 404 returned error can't find the container with id 7273d768b6853d69e7db60e1f06266638df2add7b647b143a3b5ee8e6b27ea1c Jul 06 19:05:27.163696 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.163603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:27.163871 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.163790 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:27.163871 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.163869 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.163849746 +0000 UTC m=+4.253173883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:27.264454 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.264420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:27.264639 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.264488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:27.264689 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.264639 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:27.264689 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.264649 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:27.264792 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.264721 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret podName:8426f194-af92-433c-b71d-50b6d56fcd23 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.264704971 +0000 UTC m=+4.354029109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret") pod "global-pull-secret-syncer-hfdw8" (UID: "8426f194-af92-433c-b71d-50b6d56fcd23") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:27.264792 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.264656 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:27.264792 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.264762 2581 projected.go:196] Error preparing data for projected volume kube-api-access-rg92x for pod openshift-network-diagnostics/network-check-target-nsqkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:27.264920 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.264814 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x podName:f79fbb9b-a58e-431d-9718-15aa3ee64709 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:28.264798486 +0000 UTC m=+4.354122625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg92x" (UniqueName: "kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x") pod "network-check-target-nsqkr" (UID: "f79fbb9b-a58e-431d-9718-15aa3ee64709") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:27.600522 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.600363 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:27 +0000 UTC" deadline="2028-03-30 10:34:27.332866646 +0000 UTC" Jul 06 19:05:27.600522 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.600406 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15183h28m59.732466078s" Jul 06 19:05:27.710696 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.710658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:27.710864 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.710828 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:27.711482 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.711312 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:27.711482 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:27.711418 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:27.726576 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.726490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" event={"ID":"7ff70497-3f0b-42f8-8b10-481b7d048726","Type":"ContainerStarted","Data":"d7adb9adf49149fefcdaa9a749e1c71bf563efebb7e25060e42ef41934a3531a"} Jul 06 19:05:27.728450 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.728416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" event={"ID":"2ad84f6f-5817-451d-98a0-e06dfdab6f9d","Type":"ContainerStarted","Data":"6b69dfa55ce2fb55b3fdd233464a44a7cba4982d71fcacef566e4c4da42bf3df"} Jul 06 19:05:27.730096 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.730062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h5kp8" event={"ID":"5f137841-b4b0-4311-9473-a155a6f320fe","Type":"ContainerStarted","Data":"f04e2fa82c98300813ab6de20c4f916e8aedd8ada6cb699526249dae668ecf94"} Jul 06 19:05:27.731365 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.731341 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v459d" event={"ID":"3b47e306-065b-46d6-820f-70017f7d8bbe","Type":"ContainerStarted","Data":"6115e0d8c072b702638af615bba8f3dea6a7ec4c31a4e4429b223c3a7986ce0c"} Jul 06 19:05:27.733525 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.733497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2g65w" event={"ID":"219aa01a-8349-48e1-a36c-d05e3c5ea7a8","Type":"ContainerStarted","Data":"04df450baf7311b53f4bd3ec975d78f907339f3117bc787d2a7b54b50ab1acb2"} Jul 06 19:05:27.735756 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.735730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"7273d768b6853d69e7db60e1f06266638df2add7b647b143a3b5ee8e6b27ea1c"} Jul 06 19:05:27.738712 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.738683 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhkpd" event={"ID":"baa7615f-56ab-4259-8724-8ce7275ab5e4","Type":"ContainerStarted","Data":"70589a3526e93e33f65676b168dcba70fe39866e96e1e4325b10afe601051aa8"} Jul 06 19:05:27.740838 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.740811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" event={"ID":"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c","Type":"ContainerStarted","Data":"3efedc12c5b55f33302d2fee937c6dbb66dd1459d797cd8850c251007d2bc79e"} Jul 06 19:05:27.743067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:27.743041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5z2tp" event={"ID":"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef","Type":"ContainerStarted","Data":"0881a29fae3cd45cb5d7d633727fe4a48206f1a95e2f40a452d3d2e7ed56dcee"} Jul 06 19:05:28.173121 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:28.173079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:28.173293 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.173268 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:28.173376 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.173352 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.17332108 +0000 UTC m=+6.262645230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:28.275209 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:28.274270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:28.275209 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:28.274359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:28.275209 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.274519 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:28.275209 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.274540 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:28.275209 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.274554 2581 projected.go:196] Error preparing data for projected volume kube-api-access-rg92x for pod openshift-network-diagnostics/network-check-target-nsqkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:28.275209 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.274620 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x podName:f79fbb9b-a58e-431d-9718-15aa3ee64709 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.274600372 +0000 UTC m=+6.363924516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg92x" (UniqueName: "kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x") pod "network-check-target-nsqkr" (UID: "f79fbb9b-a58e-431d-9718-15aa3ee64709") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:28.275209 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.274705 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:28.275209 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.274766 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret podName:8426f194-af92-433c-b71d-50b6d56fcd23 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.274743945 +0000 UTC m=+6.364068082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret") pod "global-pull-secret-syncer-hfdw8" (UID: "8426f194-af92-433c-b71d-50b6d56fcd23") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:28.600657 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:28.600573 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:27 +0000 UTC" deadline="2028-02-01 16:15:49.931348449 +0000 UTC" Jul 06 19:05:28.600657 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:28.600621 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13797h10m21.330732755s" Jul 06 19:05:28.724981 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:28.724245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:28.724981 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:28.724465 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:29.710810 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:29.710540 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:29.711305 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:29.710565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:29.711305 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:29.710954 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:29.711305 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:29.711009 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:29.757933 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:29.757885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" event={"ID":"61e1c42ac9a08ecfb3c8cc5e93139196","Type":"ContainerStarted","Data":"bee5208a726abc24fbe459129c1876944247ec1a2b5e27e6b40a8d0aef7c2083"} Jul 06 19:05:29.779310 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:29.779246 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" podStartSLOduration=3.779224831 podStartE2EDuration="3.779224831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:29.777990797 +0000 UTC m=+5.867314958" watchObservedRunningTime="2026-07-06 19:05:29.779224831 +0000 UTC m=+5.868548992" Jul 06 19:05:30.191413 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:30.191318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:30.191623 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.191532 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:30.191623 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.191606 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:34.191586009 +0000 UTC m=+10.280910148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:30.292079 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:30.292037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:30.292251 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:30.292114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:30.292336 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.292251 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:30.292336 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.292320 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret podName:8426f194-af92-433c-b71d-50b6d56fcd23 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:34.292300966 +0000 UTC m=+10.381625109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret") pod "global-pull-secret-syncer-hfdw8" (UID: "8426f194-af92-433c-b71d-50b6d56fcd23") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:30.292796 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.292774 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:30.292910 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.292801 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:30.292910 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.292815 2581 projected.go:196] Error preparing data for projected volume kube-api-access-rg92x for pod openshift-network-diagnostics/network-check-target-nsqkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:30.292910 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.292864 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x podName:f79fbb9b-a58e-431d-9718-15aa3ee64709 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:34.292848478 +0000 UTC m=+10.382172619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg92x" (UniqueName: "kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x") pod "network-check-target-nsqkr" (UID: "f79fbb9b-a58e-431d-9718-15aa3ee64709") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:30.711360 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:30.710508 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:30.711360 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:30.710702 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:31.711501 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:31.711456 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:31.711978 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:31.711626 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:31.712150 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:31.712053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:31.712298 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:31.712176 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:32.715180 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:32.715150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:32.715676 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:32.715290 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:33.711117 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:33.711076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:33.711341 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:33.711076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:33.711341 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:33.711225 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:33.711341 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:33.711309 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:34.224875 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:34.224841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:34.225367 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.225029 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:34.228566 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.225439 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.22541193 +0000 UTC m=+18.314736154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:34.325911 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:34.325863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:34.326111 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:34.325928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:34.326111 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.326044 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:34.326111 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.326082 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:34.326111 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.326099 2581 projected.go:196] Error preparing data for projected volume kube-api-access-rg92x for pod openshift-network-diagnostics/network-check-target-nsqkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:34.326296 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.326048 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:34.326296 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.326162 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x podName:f79fbb9b-a58e-431d-9718-15aa3ee64709 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.326145443 +0000 UTC m=+18.415469579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg92x" (UniqueName: "kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x") pod "network-check-target-nsqkr" (UID: "f79fbb9b-a58e-431d-9718-15aa3ee64709") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:34.326296 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.326216 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret podName:8426f194-af92-433c-b71d-50b6d56fcd23 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:42.326198141 +0000 UTC m=+18.415522282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret") pod "global-pull-secret-syncer-hfdw8" (UID: "8426f194-af92-433c-b71d-50b6d56fcd23") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:34.712215 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:34.712130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:34.712383 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:34.712256 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:35.710960 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:35.710882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:35.711390 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:35.710882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:35.711390 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:35.711019 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:35.711390 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:35.711083 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:36.710482 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:36.710433 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:36.710674 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:36.710592 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:37.711104 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:37.711067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:37.711104 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:37.711107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:37.711606 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:37.711181 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:37.711606 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:37.711312 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:38.710980 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:38.710940 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:38.711181 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:38.711092 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:39.711432 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:39.711390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:39.711912 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:39.711390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:39.711912 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:39.711555 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:39.711912 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:39.711629 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:40.711271 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:40.711241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:40.711424 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:40.711355 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:41.710520 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:41.710486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:41.710520 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:41.710507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:41.711035 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:41.710619 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:41.711035 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:41.710691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:42.281633 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:42.281598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:42.281835 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.281737 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:42.281835 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.281804 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:05:58.281785488 +0000 UTC m=+34.371109623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:42.382795 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:42.382760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:42.382955 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:42.382824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:42.382955 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.382943 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:42.383044 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.382951 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:42.383044 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.382977 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:42.383044 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.382991 2581 projected.go:196] Error preparing data for projected volume kube-api-access-rg92x for pod openshift-network-diagnostics/network-check-target-nsqkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:42.383044 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.383004 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret podName:8426f194-af92-433c-b71d-50b6d56fcd23 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:58.382986828 +0000 UTC m=+34.472310963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret") pod "global-pull-secret-syncer-hfdw8" (UID: "8426f194-af92-433c-b71d-50b6d56fcd23") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:42.383044 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.383040 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x podName:f79fbb9b-a58e-431d-9718-15aa3ee64709 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:58.383024314 +0000 UTC m=+34.472348467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg92x" (UniqueName: "kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x") pod "network-check-target-nsqkr" (UID: "f79fbb9b-a58e-431d-9718-15aa3ee64709") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:42.710629 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:42.710554 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:42.711005 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:42.710684 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:43.710816 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:43.710771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:43.710816 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:43.710821 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:43.711378 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:43.710948 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:43.711378 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:43.710976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:43.788395 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:43.788359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" event={"ID":"d3d20294c54eebf1cdd45bd4f32b1e5e","Type":"ContainerStarted","Data":"36028d60040f677cd5b046875ce338a0394662082429431e3b3d529c975f54b1"} Jul 06 19:05:44.711629 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:44.711595 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:44.712130 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:44.711690 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:45.710999 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:45.710967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:45.711190 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:45.711089 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:45.711190 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:45.711101 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:45.711313 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:45.711228 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:46.712709 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.712683 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:46.728248 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:46.723913 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:46.795878 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.795594 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3d20294c54eebf1cdd45bd4f32b1e5e" containerID="36028d60040f677cd5b046875ce338a0394662082429431e3b3d529c975f54b1" exitCode=0 Jul 06 19:05:46.795878 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.795672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" event={"ID":"d3d20294c54eebf1cdd45bd4f32b1e5e","Type":"ContainerDied","Data":"36028d60040f677cd5b046875ce338a0394662082429431e3b3d529c975f54b1"} Jul 06 19:05:46.797704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.797672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhkpd" event={"ID":"baa7615f-56ab-4259-8724-8ce7275ab5e4","Type":"ContainerStarted","Data":"10f630fcf242d243a7ae7695612c410ce9732abb942ae5eb37a5d8fc95160033"} Jul 06 19:05:46.802548 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.802457 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" event={"ID":"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c","Type":"ContainerStarted","Data":"632dee705aef1d1b73021efa48e4816e7045b913b027e8013e4ab21eab70ea25"} Jul 06 19:05:46.806059 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.806021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5z2tp" event={"ID":"5efa33d4-4aab-46fb-a9e1-687e3d4b07ef","Type":"ContainerStarted","Data":"a93cbc43f7aefafd1f9e16f33a4c8c8e911b5e8aff86a77b85417eda9bae5cc0"} Jul 06 19:05:46.813273 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.813104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" event={"ID":"7ff70497-3f0b-42f8-8b10-481b7d048726","Type":"ContainerStarted","Data":"c9a52419eff28bf38a9eeb1835758eb1835526d01000d2d37901b93180038250"} Jul 06 19:05:46.859002 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.858946 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5z2tp" podStartSLOduration=2.465298081 podStartE2EDuration="21.858910499s" totalImagesPullingTime="19.393612418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:46.835644679 +0000 UTC m=+22.924968838" watchObservedRunningTime="2026-07-06 19:05:46.858910499 +0000 UTC m=+22.948234657" Jul 06 19:05:46.859211 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.859163 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mhkpd" podStartSLOduration=2.21374525 podStartE2EDuration="21.859155597s" totalImagesPullingTime="19.645410347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:46.858311605 +0000 UTC m=+22.947635763" watchObservedRunningTime="2026-07-06 19:05:46.859155597 +0000 UTC m=+22.948479756" Jul 06 19:05:46.880033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:46.879854 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gjwk7" podStartSLOduration=2.165348515 podStartE2EDuration="21.879831514s" totalImagesPullingTime="19.714482999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:46.879751747 +0000 UTC m=+22.969075906" watchObservedRunningTime="2026-07-06 19:05:46.879831514 +0000 UTC m=+22.969155672" Jul 06 19:05:47.711164 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.711131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:47.711367 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.711131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:47.711367 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:47.711256 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:47.711367 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:47.711324 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:47.825094 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.825062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" event={"ID":"d3d20294c54eebf1cdd45bd4f32b1e5e","Type":"ContainerStarted","Data":"7da5927757e4ad77ede455767d4fe4b1c2c0cff23f26f0203b90a1ef278bc759"} Jul 06 19:05:47.826635 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.826612 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ad84f6f-5817-451d-98a0-e06dfdab6f9d" containerID="7cda4c815570b4b2d04e3cd4f81eab262f5d3eb83559b10b48f5d305e47e0c5f" exitCode=0 Jul 06 19:05:47.826749 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.826685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" event={"ID":"2ad84f6f-5817-451d-98a0-e06dfdab6f9d","Type":"ContainerDied","Data":"7cda4c815570b4b2d04e3cd4f81eab262f5d3eb83559b10b48f5d305e47e0c5f"} Jul 06 19:05:47.828177 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.828146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h5kp8" event={"ID":"5f137841-b4b0-4311-9473-a155a6f320fe","Type":"ContainerStarted","Data":"b9be1ae3022d52ef7b51de5c64c46f9070ede16488075dbfce20a3a8f9eb1665"} Jul 06 19:05:47.829985 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.829965 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2g65w" event={"ID":"219aa01a-8349-48e1-a36c-d05e3c5ea7a8","Type":"ContainerStarted","Data":"b047000de39030420854119c76b9088c8f9d90c581a499c5f75076028b757b4a"} Jul 06 19:05:47.833351 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.833323 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"4044cb1227459cea2e3d2326bd6d0d61acadc56515a3b2ddd4b566f875ea6985"} Jul 06 19:05:47.833457 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.833404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"f7dff204443a3c53ebafcf8ba92d2f759f4414a190b0786f50936b0bef6845bd"} Jul 06 19:05:47.833538 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.833454 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"b1cf35728f718cd001b9b053f1f7f771aef30d6417505624f3729c83ebc4cead"} Jul 06 19:05:47.833538 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.833524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"3d623baad97c747eae3aacd35e7fd1634f2cdb9256893110966386e735177128"} Jul 06 19:05:47.833624 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.833571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"fb3d9a80278eeb6960fe162ea006b452e6340e9a389ba32233a644fa8d04a2b9"} Jul 06 19:05:47.833624 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.833620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"8d87f85e00afc7edb3925ffba493b074ea8c2140801463248c2529e5f1b559ae"} Jul 06 19:05:47.842420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.842385 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" podStartSLOduration=21.84237301 podStartE2EDuration="21.84237301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:47.841780551 +0000 UTC m=+23.931104710" watchObservedRunningTime="2026-07-06 19:05:47.84237301 +0000 UTC m=+23.931697166" Jul 06 19:05:47.856884 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.856846 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2g65w" podStartSLOduration=3.409549097 podStartE2EDuration="22.856834301s" totalImagesPullingTime="19.447285204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:47.85661363 +0000 UTC m=+23.945937787" watchObservedRunningTime="2026-07-06 19:05:47.856834301 +0000 UTC m=+23.946158457" Jul 06 19:05:47.874594 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:47.874562 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h5kp8" podStartSLOduration=3.495742497 podStartE2EDuration="22.874552282s" totalImagesPullingTime="19.378809785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:47.874528619 +0000 UTC m=+23.963852778" watchObservedRunningTime="2026-07-06 19:05:47.874552282 +0000 UTC m=+23.963876439" Jul 06 19:05:48.589288 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:48.589233 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:05:48.606578 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:48.606502 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:05:48.589254403Z","UUID":"49d1035f-9607-46fe-8d9b-52a39ef64b15","Handler":null,"Name":"","Endpoint":""} Jul 06 19:05:48.607874 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:48.607859 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:05:48.607967 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:48.607891 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:05:48.711493 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:48.711399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:48.711665 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:48.711534 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:48.837846 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:48.837813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" event={"ID":"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c","Type":"ContainerStarted","Data":"222a68ce71d7bdca40b1f2e7bf82f1c62d2bd9f8128b4e1edb23ed05ebf1ab8a"} Jul 06 19:05:48.839574 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:48.839540 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v459d" event={"ID":"3b47e306-065b-46d6-820f-70017f7d8bbe","Type":"ContainerStarted","Data":"efcde6d1dfa4ccc0617b85862e4143eb8104c1626773fd579934ebdff90578c4"} Jul 06 19:05:48.858410 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:48.858361 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v459d" podStartSLOduration=4.197501091 podStartE2EDuration="23.858342382s" totalImagesPullingTime="19.660841291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:48.857816054 +0000 UTC m=+24.947140258" watchObservedRunningTime="2026-07-06 19:05:48.858342382 +0000 UTC m=+24.947666541" Jul 06 19:05:49.711249 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:49.711056 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:49.711420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:49.711058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:49.711420 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:49.711352 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:49.711594 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:49.711439 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:49.845975 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:49.845937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"a8a7834c14a7c6a05b2120461863667752b7d16f2b6a4effd2c1ed1a6861f847"} Jul 06 19:05:50.148211 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:50.148132 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:50.148671 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:50.148653 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:50.710842 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:50.710809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:50.711024 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:50.710946 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:50.850361 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:50.850329 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" event={"ID":"8b7a9ff7-4e5d-4a8d-a14e-95e3422c291c","Type":"ContainerStarted","Data":"0d60b95c1b0e319f089d3f12432e6d085aee3403dbe966d5fb0d8371f35ad074"} Jul 06 19:05:50.850932 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:50.850581 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:50.851026 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:50.851011 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2g65w" Jul 06 19:05:50.873625 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:50.873578 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58kwk" podStartSLOduration=11.908253839 podStartE2EDuration="25.873564941s" totalImagesPullingTime="13.965311102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.873228931 +0000 UTC m=+26.962553088" watchObservedRunningTime="2026-07-06 19:05:50.873564941 +0000 UTC m=+26.962889119" Jul 06 19:05:51.710555 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:51.710524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:51.710732 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:51.710616 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:51.710732 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:51.710656 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:51.710732 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:51.710710 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:52.711303 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:52.711106 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:52.711888 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:52.711400 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:52.863434 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:52.863399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" event={"ID":"4cdf8509-3a00-466d-9021-7b1929a9e147","Type":"ContainerStarted","Data":"def59d3b3bc220d6699df5a3c68958ac9908142ce16c4d28c7f45ce4943c1b3c"} Jul 06 19:05:52.891852 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:52.891801 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" podStartSLOduration=8.168035402 podStartE2EDuration="27.891787973s" totalImagesPullingTime="19.723752571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:52.891529927 +0000 UTC m=+28.980854086" watchObservedRunningTime="2026-07-06 19:05:52.891787973 +0000 UTC m=+28.981112129" Jul 06 19:05:53.710485 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.710446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:53.710588 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.710451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:53.710623 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:53.710592 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:53.710688 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:53.710662 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:53.867633 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.867606 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ad84f6f-5817-451d-98a0-e06dfdab6f9d" containerID="6dadf3a1c65671fe333ddcaa999b4e146b634bf9292d73c1055d3b68a31c88e6" exitCode=0 Jul 06 19:05:53.868073 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.867678 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" event={"ID":"2ad84f6f-5817-451d-98a0-e06dfdab6f9d","Type":"ContainerDied","Data":"6dadf3a1c65671fe333ddcaa999b4e146b634bf9292d73c1055d3b68a31c88e6"} Jul 06 19:05:53.868277 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.868254 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:53.868414 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.868329 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:53.868414 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.868376 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:53.883508 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.883484 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:53.884106 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:53.884092 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:05:54.070951 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:54.070922 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hfdw8"] Jul 06 19:05:54.071131 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:54.071031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:54.071189 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:54.071140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:54.071578 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:54.071564 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nsqkr"] Jul 06 19:05:54.071637 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:54.071628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:54.071705 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:54.071691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:54.073062 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:54.073040 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vbkcv"] Jul 06 19:05:54.073174 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:54.073117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:54.073236 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:54.073201 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:55.711201 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:55.711032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:55.711605 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:55.711033 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:55.711605 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:55.711284 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:55.711605 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:55.711088 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:55.711605 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:55.711350 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:55.711605 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:55.711446 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:55.873928 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:55.873893 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ad84f6f-5817-451d-98a0-e06dfdab6f9d" containerID="a9361dd41f505880e83a03be91bb638841b798fa76c1525ce10512dca95a6176" exitCode=0 Jul 06 19:05:55.874064 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:55.873968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" event={"ID":"2ad84f6f-5817-451d-98a0-e06dfdab6f9d","Type":"ContainerDied","Data":"a9361dd41f505880e83a03be91bb638841b798fa76c1525ce10512dca95a6176"} Jul 06 19:05:56.877834 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:56.877749 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ad84f6f-5817-451d-98a0-e06dfdab6f9d" containerID="aebe10764186237aed85a6d98c8a35982bd088b6264e0fedb9f8700ae28d988b" exitCode=0 Jul 06 19:05:56.877834 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:56.877806 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" event={"ID":"2ad84f6f-5817-451d-98a0-e06dfdab6f9d","Type":"ContainerDied","Data":"aebe10764186237aed85a6d98c8a35982bd088b6264e0fedb9f8700ae28d988b"} Jul 06 19:05:57.711122 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:57.711092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:57.711317 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:57.711092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:57.711317 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:57.711235 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:57.711317 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:57.711091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:57.711317 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:57.711298 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:05:57.711531 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:57.711365 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:58.322274 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:58.322242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:58.322705 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:58.322454 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:58.322705 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:58.322544 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:06:30.322523491 +0000 UTC m=+66.411847640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:05:58.423372 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:58.423342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:58.423547 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:58.423512 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:58.423628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:58.423514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:58.423628 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:58.423580 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret podName:8426f194-af92-433c-b71d-50b6d56fcd23 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:30.423560858 +0000 UTC m=+66.512885003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret") pod "global-pull-secret-syncer-hfdw8" (UID: "8426f194-af92-433c-b71d-50b6d56fcd23") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:05:58.423628 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:58.423604 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:05:58.423628 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:58.423623 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:05:58.423825 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:58.423633 2581 projected.go:196] Error preparing data for projected volume kube-api-access-rg92x for pod openshift-network-diagnostics/network-check-target-nsqkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:58.423825 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:58.423674 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x podName:f79fbb9b-a58e-431d-9718-15aa3ee64709 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:30.423663596 +0000 UTC m=+66.512987732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rg92x" (UniqueName: "kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x") pod "network-check-target-nsqkr" (UID: "f79fbb9b-a58e-431d-9718-15aa3ee64709") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:05:59.710543 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:59.710512 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:05:59.711021 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:59.710513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:05:59.711021 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:59.710620 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsqkr" podUID="f79fbb9b-a58e-431d-9718-15aa3ee64709" Jul 06 19:05:59.711021 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:05:59.710513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:05:59.711021 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:59.710709 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfdw8" podUID="8426f194-af92-433c-b71d-50b6d56fcd23" Jul 06 19:05:59.711021 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:05:59.710816 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:06:00.228279 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.228121 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeReady" Jul 06 19:06:00.228429 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.228374 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:06:00.278028 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.277993 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bgf9z"] Jul 06 19:06:00.280423 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.280404 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nbhrc"] Jul 06 19:06:00.280555 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.280537 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.282499 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.282451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nbhrc" Jul 06 19:06:00.282827 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.282810 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:06:00.282897 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.282838 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:06:00.282949 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.282917 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjqpd\"" Jul 06 19:06:00.284817 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.284795 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qlc5\"" Jul 06 19:06:00.284817 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.284812 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:06:00.284817 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.284822 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:06:00.285022 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.284942 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:06:00.289486 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.289450 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nbhrc"] Jul 06 19:06:00.292657 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.292639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgf9z"] Jul 06 19:06:00.437789 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.437709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33b13a8a-5a99-4d9c-ac94-512a42898c15-config-volume\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.437789 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.437745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.437789 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.437773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05cabb41-49be-452e-b240-1447ec5b47bf-cert\") pod \"ingress-canary-nbhrc\" (UID: \"05cabb41-49be-452e-b240-1447ec5b47bf\") " pod="openshift-ingress-canary/ingress-canary-nbhrc" Jul 06 19:06:00.438048 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.437814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5d9t\" (UniqueName: \"kubernetes.io/projected/05cabb41-49be-452e-b240-1447ec5b47bf-kube-api-access-p5d9t\") pod \"ingress-canary-nbhrc\" (UID: \"05cabb41-49be-452e-b240-1447ec5b47bf\") " pod="openshift-ingress-canary/ingress-canary-nbhrc" Jul 06 19:06:00.438048 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.437837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6759\" (UniqueName: \"kubernetes.io/projected/33b13a8a-5a99-4d9c-ac94-512a42898c15-kube-api-access-g6759\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.438048 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.437890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b13a8a-5a99-4d9c-ac94-512a42898c15-tmp-dir\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.538275 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.538235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5d9t\" (UniqueName: \"kubernetes.io/projected/05cabb41-49be-452e-b240-1447ec5b47bf-kube-api-access-p5d9t\") pod \"ingress-canary-nbhrc\" (UID: \"05cabb41-49be-452e-b240-1447ec5b47bf\") " pod="openshift-ingress-canary/ingress-canary-nbhrc" Jul 06 19:06:00.538275 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.538277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6759\" (UniqueName: \"kubernetes.io/projected/33b13a8a-5a99-4d9c-ac94-512a42898c15-kube-api-access-g6759\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.538562 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.538334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b13a8a-5a99-4d9c-ac94-512a42898c15-tmp-dir\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.538562 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.538381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33b13a8a-5a99-4d9c-ac94-512a42898c15-config-volume\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.538562 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.538406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.538562 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.538432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05cabb41-49be-452e-b240-1447ec5b47bf-cert\") pod \"ingress-canary-nbhrc\" (UID: \"05cabb41-49be-452e-b240-1447ec5b47bf\") " pod="openshift-ingress-canary/ingress-canary-nbhrc" Jul 06 19:06:00.538777 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:00.538754 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:06:00.538848 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:00.538831 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:01.038811326 +0000 UTC m=+37.128135466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:06:00.539015 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.538989 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b13a8a-5a99-4d9c-ac94-512a42898c15-tmp-dir\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.539264 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.539241 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33b13a8a-5a99-4d9c-ac94-512a42898c15-config-volume\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.542879 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.542861 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05cabb41-49be-452e-b240-1447ec5b47bf-cert\") pod \"ingress-canary-nbhrc\" (UID: \"05cabb41-49be-452e-b240-1447ec5b47bf\") " pod="openshift-ingress-canary/ingress-canary-nbhrc" Jul 06 19:06:00.548165 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.548143 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5d9t\" (UniqueName: \"kubernetes.io/projected/05cabb41-49be-452e-b240-1447ec5b47bf-kube-api-access-p5d9t\") pod \"ingress-canary-nbhrc\" (UID: \"05cabb41-49be-452e-b240-1447ec5b47bf\") " pod="openshift-ingress-canary/ingress-canary-nbhrc" Jul 06 19:06:00.548392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.548371 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6759\" (UniqueName: \"kubernetes.io/projected/33b13a8a-5a99-4d9c-ac94-512a42898c15-kube-api-access-g6759\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:00.597455 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:00.597420 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nbhrc" Jul 06 19:06:01.041905 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.041868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:01.042282 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:01.041986 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:06:01.042282 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:01.042036 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:02.042023916 +0000 UTC m=+38.131348052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:06:01.710635 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.710596 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:06:01.710828 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.710647 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:06:01.710828 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.710605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:06:01.713442 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.713421 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:06:01.714396 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.714376 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:06:01.714533 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.714513 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb5ss\"" Jul 06 19:06:01.714593 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.714573 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26kf2\"" Jul 06 19:06:01.714632 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.714611 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:06:01.714816 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:01.714801 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:06:02.048219 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:02.048191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:02.048725 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:02.048319 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:06:02.048725 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:02.048384 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:04.048366327 +0000 UTC m=+40.137690465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:06:02.188453 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:02.188423 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nbhrc"] Jul 06 19:06:02.191690 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:06:02.191664 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cabb41_49be_452e_b240_1447ec5b47bf.slice/crio-e08f81585463b79062f3851fc378c1df763f495e7b1f4f6695ff711931803fd5 WatchSource:0}: Error finding container e08f81585463b79062f3851fc378c1df763f495e7b1f4f6695ff711931803fd5: Status 404 returned error can't find the container with id e08f81585463b79062f3851fc378c1df763f495e7b1f4f6695ff711931803fd5 Jul 06 19:06:02.893948 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:02.893746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nbhrc" event={"ID":"05cabb41-49be-452e-b240-1447ec5b47bf","Type":"ContainerStarted","Data":"e08f81585463b79062f3851fc378c1df763f495e7b1f4f6695ff711931803fd5"} Jul 06 19:06:02.896829 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:02.896801 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ad84f6f-5817-451d-98a0-e06dfdab6f9d" containerID="442149b2f2e08f6e39c5594293cd4a1e1099fdfc09c0c793626f6368f4f46ed1" exitCode=0 Jul 06 19:06:02.896956 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:02.896846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" event={"ID":"2ad84f6f-5817-451d-98a0-e06dfdab6f9d","Type":"ContainerDied","Data":"442149b2f2e08f6e39c5594293cd4a1e1099fdfc09c0c793626f6368f4f46ed1"} Jul 06 19:06:03.902394 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:03.902307 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ad84f6f-5817-451d-98a0-e06dfdab6f9d" containerID="ce79236d250ef4f561e4c15c78a857f1e7c8ef39eeaf2bc762a7098225c2e5f2" exitCode=0 Jul 06 19:06:03.902394 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:03.902378 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" event={"ID":"2ad84f6f-5817-451d-98a0-e06dfdab6f9d","Type":"ContainerDied","Data":"ce79236d250ef4f561e4c15c78a857f1e7c8ef39eeaf2bc762a7098225c2e5f2"} Jul 06 19:06:04.063790 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:04.063754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:04.063960 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:04.063920 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:06:04.064009 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:04.063981 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:08.06396534 +0000 UTC m=+44.153289475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:06:04.674191 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:04.674159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:04.762224 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:04.762174 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:04.909214 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:04.909175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" event={"ID":"2ad84f6f-5817-451d-98a0-e06dfdab6f9d","Type":"ContainerStarted","Data":"b9c735dd606a029e9e4491ed06f8f8d76a4effb3eb4280a7be46b3ee17293a69"} Jul 06 19:06:04.938386 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:04.936300 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x8mk4" podStartSLOduration=7.456220067 podStartE2EDuration="39.936114455s" totalImagesPullingTime="32.479894388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:04.933788286 +0000 UTC m=+41.023112444" watchObservedRunningTime="2026-07-06 19:06:04.936114455 +0000 UTC m=+41.025438614" Jul 06 19:06:05.073876 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:05.073844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:05.171424 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:05.171390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:05.243422 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:05.243383 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:05.913164 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:05.913075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nbhrc" event={"ID":"05cabb41-49be-452e-b240-1447ec5b47bf","Type":"ContainerStarted","Data":"fddd4247acc7f2f5d1bb2c2dc48b59abc3184f17db21de928d5fb99eb83c617d"} Jul 06 19:06:05.934215 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:05.934146 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nbhrc" podStartSLOduration=2.669325342 podStartE2EDuration="5.934127891s" totalImagesPullingTime="3.264802549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:05.933180265 +0000 UTC m=+42.022504423" watchObservedRunningTime="2026-07-06 19:06:05.934127891 +0000 UTC m=+42.023452051" Jul 06 19:06:08.093344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:08.093308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:08.093852 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:08.093500 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:06:08.093852 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:08.093588 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:16.093566438 +0000 UTC m=+52.182890577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:06:08.120564 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:08.120541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:08.208647 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:08.208618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:09.522323 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:09.522292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:12.213291 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:12.213227 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:12.312581 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:12.312553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:13.374803 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:13.374771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:13.475244 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:13.475208 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:14.865688 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:14.865654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:14.965936 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:14.965909 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:16.149212 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:16.149170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:16.149619 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:16.149321 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:06:16.149619 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:16.149395 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:32.149378609 +0000 UTC m=+68.238702744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:06:16.384990 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:16.384956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:16.492598 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:16.492570 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:25.890687 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:25.890657 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44c4t" Jul 06 19:06:26.034842 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:26.034798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:26.136816 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:26.136787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:26.235650 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:26.235598 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:26.336552 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:26.336523 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:06:30.338329 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.338281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:06:30.341211 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.341191 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:06:30.349431 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:30.349400 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:06:30.349503 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:30.349489 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:07:34.349453483 +0000 UTC m=+130.438777623 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : secret "metrics-daemon-secret" not found Jul 06 19:06:30.439121 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.439087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:06:30.439193 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.439162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:06:30.442072 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.442055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:06:30.442122 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.442107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:06:30.452944 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.452922 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:06:30.453451 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.453435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8426f194-af92-433c-b71d-50b6d56fcd23-original-pull-secret\") pod \"global-pull-secret-syncer-hfdw8\" (UID: \"8426f194-af92-433c-b71d-50b6d56fcd23\") " pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:06:30.462452 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.462430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg92x\" (UniqueName: \"kubernetes.io/projected/f79fbb9b-a58e-431d-9718-15aa3ee64709-kube-api-access-rg92x\") pod \"network-check-target-nsqkr\" (UID: \"f79fbb9b-a58e-431d-9718-15aa3ee64709\") " pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:06:30.522691 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.522659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfdw8" Jul 06 19:06:30.532581 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.532562 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26kf2\"" Jul 06 19:06:30.540088 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.540064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:06:30.675277 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.675247 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hfdw8"] Jul 06 19:06:30.678413 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:06:30.678388 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8426f194_af92_433c_b71d_50b6d56fcd23.slice/crio-23e8bb5bbf3a2f384b7ff69866f5454e0d47e6d75308028c2923b399b865480e WatchSource:0}: Error finding container 23e8bb5bbf3a2f384b7ff69866f5454e0d47e6d75308028c2923b399b865480e: Status 404 returned error can't find the container with id 23e8bb5bbf3a2f384b7ff69866f5454e0d47e6d75308028c2923b399b865480e Jul 06 19:06:30.691114 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.691088 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nsqkr"] Jul 06 19:06:30.694254 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:06:30.694231 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf79fbb9b_a58e_431d_9718_15aa3ee64709.slice/crio-3e0673a1843aa8dd868a72537a208fd170cf562b1cd83cbd419c17085ff6e48a WatchSource:0}: Error finding container 3e0673a1843aa8dd868a72537a208fd170cf562b1cd83cbd419c17085ff6e48a: Status 404 returned error can't find the container with id 3e0673a1843aa8dd868a72537a208fd170cf562b1cd83cbd419c17085ff6e48a Jul 06 19:06:30.975168 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.975123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hfdw8" event={"ID":"8426f194-af92-433c-b71d-50b6d56fcd23","Type":"ContainerStarted","Data":"23e8bb5bbf3a2f384b7ff69866f5454e0d47e6d75308028c2923b399b865480e"} Jul 06 19:06:30.976115 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:30.976094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nsqkr" event={"ID":"f79fbb9b-a58e-431d-9718-15aa3ee64709","Type":"ContainerStarted","Data":"3e0673a1843aa8dd868a72537a208fd170cf562b1cd83cbd419c17085ff6e48a"} Jul 06 19:06:32.151512 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:32.151475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:06:32.151891 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:32.151582 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:06:32.151891 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:06:32.151630 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:04.151617593 +0000 UTC m=+100.240941729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:06:35.989074 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:35.989030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nsqkr" event={"ID":"f79fbb9b-a58e-431d-9718-15aa3ee64709","Type":"ContainerStarted","Data":"40f5c866bbc32ad2de1af235e3c9046b70818a9e8bd906703c82e69f5ff82951"} Jul 06 19:06:35.989583 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:35.989134 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:06:35.991052 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:35.991025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hfdw8" event={"ID":"8426f194-af92-433c-b71d-50b6d56fcd23","Type":"ContainerStarted","Data":"a5d7ba853621fea9071d30ebeb156027ae794b80e361ca9c2cd5873a4bdd9c0e"} Jul 06 19:06:36.008108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:36.008052 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nsqkr" podStartSLOduration=65.906738147 podStartE2EDuration="1m11.00803492s" totalImagesPullingTime="5.101296773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:36.007587634 +0000 UTC m=+72.096911793" watchObservedRunningTime="2026-07-06 19:06:36.00803492 +0000 UTC m=+72.097359078" Jul 06 19:06:36.025348 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:36.025301 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hfdw8" podStartSLOduration=64.907816211 podStartE2EDuration="1m10.025289872s" totalImagesPullingTime="5.117473661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:36.024931054 +0000 UTC m=+72.114255213" watchObservedRunningTime="2026-07-06 19:06:36.025289872 +0000 UTC m=+72.114614029" Jul 06 19:06:40.046596 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:06:40.046563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:04.161975 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:07:04.161931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:07:04.162360 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:07:04.162076 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:04.162360 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:07:04.162147 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:08.162130355 +0000 UTC m=+164.251454513 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:07:04.253343 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:07:04.253306 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:06.995665 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:07:06.995634 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nsqkr" Jul 06 19:07:32.763265 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:07:32.763235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:34.356084 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:07:34.356040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:07:34.356527 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:07:34.356160 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:07:34.356527 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:07:34.356237 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:09:36.35622253 +0000 UTC m=+252.445546665 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : secret "metrics-daemon-secret" not found Jul 06 19:08:03.292508 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:08:03.292434 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bgf9z" podUID="33b13a8a-5a99-4d9c-ac94-512a42898c15" Jul 06 19:08:04.199911 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:08:04.199879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgf9z" Jul 06 19:08:04.734684 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:08:04.734640 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:08:08.179712 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:08:08.179672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:08:08.180086 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:08:08.179793 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:08:08.180086 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:08:08.179843 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls podName:33b13a8a-5a99-4d9c-ac94-512a42898c15 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:10.179829307 +0000 UTC m=+286.269153441 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls") pod "dns-default-bgf9z" (UID: "33b13a8a-5a99-4d9c-ac94-512a42898c15") : secret "dns-default-metrics-tls" not found Jul 06 19:08:17.710458 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:08:17.710361 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:08:58.016282 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:08:58.016228 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:29.464912 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.464878 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm"] Jul 06 19:09:29.466930 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.466909 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rb7xt"] Jul 06 19:09:29.467043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.467023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm" Jul 06 19:09:29.468501 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.468485 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992"] Jul 06 19:09:29.468637 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.468618 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.469373 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.469356 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 19:09:29.469535 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.469518 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:09:29.469825 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.469811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4vq5m\"" Jul 06 19:09:29.469979 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.469966 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:29.472427 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.472406 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-j624n\"" Jul 06 19:09:29.472549 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.472492 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:09:29.472549 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.472505 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 19:09:29.472549 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.472525 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 19:09:29.472699 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.472604 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:09:29.473140 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.473123 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:09:29.473271 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.473250 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:09:29.473363 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.473288 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:09:29.474096 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.473815 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l6h25\"" Jul 06 19:09:29.478011 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.477991 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 19:09:29.478375 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.478357 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm"] Jul 06 19:09:29.484852 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.484829 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rb7xt"] Jul 06 19:09:29.485455 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.485432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992"] Jul 06 19:09:29.521814 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.521774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:29.521814 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.521807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc5fdac8-1e13-4482-8396-39419138335a-serving-cert\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.522054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.521830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5fdac8-1e13-4482-8396-39419138335a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.522054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.521857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhcct\" (UniqueName: \"kubernetes.io/projected/fc5fdac8-1e13-4482-8396-39419138335a-kube-api-access-qhcct\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.522054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.521901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc5fdac8-1e13-4482-8396-39419138335a-snapshots\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.522054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.521923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5fdac8-1e13-4482-8396-39419138335a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.522054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.521954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-955w4\" (UniqueName: \"kubernetes.io/projected/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-kube-api-access-955w4\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:29.522054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.522003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc5fdac8-1e13-4482-8396-39419138335a-tmp\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.522054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.522025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqcw\" (UniqueName: \"kubernetes.io/projected/975c0e3a-dcea-44ba-b27e-d924b05a8338-kube-api-access-7kqcw\") pod \"volume-data-source-validator-5d456fdbcd-z4xtm\" (UID: \"975c0e3a-dcea-44ba-b27e-d924b05a8338\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm" Jul 06 19:09:29.552827 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.552795 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt"] Jul 06 19:09:29.554713 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.554692 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt" Jul 06 19:09:29.555088 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.555069 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-d8728"] Jul 06 19:09:29.556610 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.556594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:29.558354 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.558332 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-77fvs\"" Jul 06 19:09:29.559002 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.558986 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 19:09:29.559155 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.559129 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8b56cf666-pvxft"] Jul 06 19:09:29.559230 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.559216 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-x679p\"" Jul 06 19:09:29.559327 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.559308 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 19:09:29.560966 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.560944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.568905 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.568885 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 19:09:29.569007 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.568991 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-55x6z\"" Jul 06 19:09:29.569945 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.569927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 19:09:29.570214 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.570197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt"] Jul 06 19:09:29.570363 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.570342 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 19:09:29.576442 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.576424 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 19:09:29.576682 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.576663 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-d8728"] Jul 06 19:09:29.582366 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.582348 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8b56cf666-pvxft"] Jul 06 19:09:29.623045 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-installation-pull-secrets\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.623045 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:29.623299 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc5fdac8-1e13-4482-8396-39419138335a-serving-cert\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.623299 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h89f\" (UniqueName: \"kubernetes.io/projected/e0698c60-a88c-4bb7-9f8c-d992ee12ce74-kube-api-access-2h89f\") pod \"network-check-source-989f8b8dc-bb8gt\" (UID: \"e0698c60-a88c-4bb7-9f8c-d992ee12ce74\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt" Jul 06 19:09:29.623299 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-certificates\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.623299 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.623196 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:09:29.623299 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5fdac8-1e13-4482-8396-39419138335a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.623299 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhcct\" (UniqueName: \"kubernetes.io/projected/fc5fdac8-1e13-4482-8396-39419138335a-kube-api-access-qhcct\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.623323 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls podName:87a3cc9a-4ef9-4bde-b663-e507ba4c915a nodeName:}" failed. No retries permitted until 2026-07-06 19:09:30.123294852 +0000 UTC m=+246.212618992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mq992" (UID: "87a3cc9a-4ef9-4bde-b663-e507ba4c915a") : secret "samples-operator-tls" not found Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc5fdac8-1e13-4482-8396-39419138335a-snapshots\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-bound-sa-token\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5fdac8-1e13-4482-8396-39419138335a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-image-registry-private-configuration\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hc2q\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-kube-api-access-9hc2q\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:29.623622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-955w4\" (UniqueName: \"kubernetes.io/projected/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-kube-api-access-955w4\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:29.624060 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-trusted-ca\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.624060 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc5fdac8-1e13-4482-8396-39419138335a-tmp\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.624060 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqcw\" (UniqueName: \"kubernetes.io/projected/975c0e3a-dcea-44ba-b27e-d924b05a8338-kube-api-access-7kqcw\") pod \"volume-data-source-validator-5d456fdbcd-z4xtm\" (UID: \"975c0e3a-dcea-44ba-b27e-d924b05a8338\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm" Jul 06 19:09:29.624060 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e714f25-7037-4a04-89a5-aa1cefa14504-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:29.624060 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4737cd7a-6e47-4b01-b952-266b99c5da84-ca-trust-extracted\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.624060 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.623908 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5fdac8-1e13-4482-8396-39419138335a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.624259 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.624074 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc5fdac8-1e13-4482-8396-39419138335a-tmp\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.624259 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.624067 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc5fdac8-1e13-4482-8396-39419138335a-snapshots\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.624259 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.624168 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5fdac8-1e13-4482-8396-39419138335a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.625588 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.625564 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc5fdac8-1e13-4482-8396-39419138335a-serving-cert\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.634053 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.634027 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhcct\" (UniqueName: \"kubernetes.io/projected/fc5fdac8-1e13-4482-8396-39419138335a-kube-api-access-qhcct\") pod \"insights-operator-5c847dcfc4-rb7xt\" (UID: \"fc5fdac8-1e13-4482-8396-39419138335a\") " pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.634954 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.634936 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqcw\" (UniqueName: \"kubernetes.io/projected/975c0e3a-dcea-44ba-b27e-d924b05a8338-kube-api-access-7kqcw\") pod \"volume-data-source-validator-5d456fdbcd-z4xtm\" (UID: \"975c0e3a-dcea-44ba-b27e-d924b05a8338\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm" Jul 06 19:09:29.635070 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.635042 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-955w4\" (UniqueName: \"kubernetes.io/projected/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-kube-api-access-955w4\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:29.651340 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.651311 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48"] Jul 06 19:09:29.653843 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.653829 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.658321 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.657270 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 19:09:29.658321 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.657909 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:09:29.658321 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.658043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wd4mt\"" Jul 06 19:09:29.660747 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.659370 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 19:09:29.660747 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.659511 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:09:29.664508 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.664458 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48"] Jul 06 19:09:29.724506 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-installation-pull-secrets\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.724506 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4737cd7a-6e47-4b01-b952-266b99c5da84-ca-trust-extracted\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.724728 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.724728 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h89f\" (UniqueName: \"kubernetes.io/projected/e0698c60-a88c-4bb7-9f8c-d992ee12ce74-kube-api-access-2h89f\") pod \"network-check-source-989f8b8dc-bb8gt\" (UID: \"e0698c60-a88c-4bb7-9f8c-d992ee12ce74\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt" Jul 06 19:09:29.724728 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-certificates\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.724728 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hc2q\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-kube-api-access-9hc2q\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.724929 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.724929 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-bound-sa-token\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.724929 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtnk7\" (UniqueName: \"kubernetes.io/projected/9c6ca05c-aed5-44af-8ddb-2050967e3d20-kube-api-access-mtnk7\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.724929 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-image-registry-private-configuration\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.724929 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:29.724929 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724904 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4737cd7a-6e47-4b01-b952-266b99c5da84-ca-trust-extracted\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.724929 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.724909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c6ca05c-aed5-44af-8ddb-2050967e3d20-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.725265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.725000 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:09:29.725265 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.725052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-trusted-ca\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.725265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.725063 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert podName:0e714f25-7037-4a04-89a5-aa1cefa14504 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:30.225045087 +0000 UTC m=+246.314369231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-d8728" (UID: "0e714f25-7037-4a04-89a5-aa1cefa14504") : secret "networking-console-plugin-cert" not found Jul 06 19:09:29.725265 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.725104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e714f25-7037-4a04-89a5-aa1cefa14504-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:29.725265 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.725176 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-certificates\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.725672 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.725647 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:09:29.725672 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.725673 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b56cf666-pvxft: secret "image-registry-tls" not found Jul 06 19:09:29.725844 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.725729 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls podName:4737cd7a-6e47-4b01-b952-266b99c5da84 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:30.225712667 +0000 UTC m=+246.315036810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls") pod "image-registry-8b56cf666-pvxft" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84") : secret "image-registry-tls" not found Jul 06 19:09:29.725844 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.725795 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e714f25-7037-4a04-89a5-aa1cefa14504-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:29.725949 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.725879 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-trusted-ca\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.726886 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.726862 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-installation-pull-secrets\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.726995 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.726977 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-image-registry-private-configuration\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.733495 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.733450 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h89f\" (UniqueName: \"kubernetes.io/projected/e0698c60-a88c-4bb7-9f8c-d992ee12ce74-kube-api-access-2h89f\") pod \"network-check-source-989f8b8dc-bb8gt\" (UID: \"e0698c60-a88c-4bb7-9f8c-d992ee12ce74\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt" Jul 06 19:09:29.735714 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.735689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-bound-sa-token\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.735792 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.735758 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hc2q\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-kube-api-access-9hc2q\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:29.765760 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.765731 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:29.777572 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.777553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm" Jul 06 19:09:29.785282 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.785260 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" Jul 06 19:09:29.825930 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.825765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnk7\" (UniqueName: \"kubernetes.io/projected/9c6ca05c-aed5-44af-8ddb-2050967e3d20-kube-api-access-mtnk7\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.825930 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.825840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c6ca05c-aed5-44af-8ddb-2050967e3d20-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.826128 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.826102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.826287 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.826269 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:29.826361 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:29.826354 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls podName:9c6ca05c-aed5-44af-8ddb-2050967e3d20 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:30.326334848 +0000 UTC m=+246.415659000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dld48" (UID: "9c6ca05c-aed5-44af-8ddb-2050967e3d20") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:29.826775 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.826745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c6ca05c-aed5-44af-8ddb-2050967e3d20-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.828496 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.828410 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:29.836152 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.836082 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtnk7\" (UniqueName: \"kubernetes.io/projected/9c6ca05c-aed5-44af-8ddb-2050967e3d20-kube-api-access-mtnk7\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:29.864764 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.864729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt" Jul 06 19:09:29.908011 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.907921 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm"] Jul 06 19:09:29.911246 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:09:29.911215 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975c0e3a_dcea_44ba_b27e_d924b05a8338.slice/crio-e1df26415c7097afba3ae01690bec8ee6f09e4ef222d5c89f06c8e03ab2526ea WatchSource:0}: Error finding container e1df26415c7097afba3ae01690bec8ee6f09e4ef222d5c89f06c8e03ab2526ea: Status 404 returned error can't find the container with id e1df26415c7097afba3ae01690bec8ee6f09e4ef222d5c89f06c8e03ab2526ea Jul 06 19:09:29.927840 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:29.927818 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rb7xt"] Jul 06 19:09:29.931248 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:09:29.931208 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5fdac8_1e13_4482_8396_39419138335a.slice/crio-0ff2ff90a435dfcdba418143fd7a3f3db957e5bffa2aba45758d695b4a6b1052 WatchSource:0}: Error finding container 0ff2ff90a435dfcdba418143fd7a3f3db957e5bffa2aba45758d695b4a6b1052: Status 404 returned error can't find the container with id 0ff2ff90a435dfcdba418143fd7a3f3db957e5bffa2aba45758d695b4a6b1052 Jul 06 19:09:30.000538 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.000426 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt"] Jul 06 19:09:30.003003 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:09:30.002976 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0698c60_a88c_4bb7_9f8c_d992ee12ce74.slice/crio-e080fff5113643dac15b38a03fcca0ab12d29992dc513af0019e0c0b879ccefd WatchSource:0}: Error finding container e080fff5113643dac15b38a03fcca0ab12d29992dc513af0019e0c0b879ccefd: Status 404 returned error can't find the container with id e080fff5113643dac15b38a03fcca0ab12d29992dc513af0019e0c0b879ccefd Jul 06 19:09:30.128219 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.128181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:30.128377 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.128307 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:09:30.128377 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.128367 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls podName:87a3cc9a-4ef9-4bde-b663-e507ba4c915a nodeName:}" failed. No retries permitted until 2026-07-06 19:09:31.128352447 +0000 UTC m=+247.217676582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mq992" (UID: "87a3cc9a-4ef9-4bde-b663-e507ba4c915a") : secret "samples-operator-tls" not found Jul 06 19:09:30.229423 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.229386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:30.229605 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.229429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:30.229605 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.229570 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:09:30.229605 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.229592 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b56cf666-pvxft: secret "image-registry-tls" not found Jul 06 19:09:30.229704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.229638 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls podName:4737cd7a-6e47-4b01-b952-266b99c5da84 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:31.229624487 +0000 UTC m=+247.318948627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls") pod "image-registry-8b56cf666-pvxft" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84") : secret "image-registry-tls" not found Jul 06 19:09:30.229704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.229572 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:09:30.229704 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.229701 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert podName:0e714f25-7037-4a04-89a5-aa1cefa14504 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:31.229689633 +0000 UTC m=+247.319013768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-d8728" (UID: "0e714f25-7037-4a04-89a5-aa1cefa14504") : secret "networking-console-plugin-cert" not found Jul 06 19:09:30.330091 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.330004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:30.330234 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.330163 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:30.330234 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:30.330229 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls podName:9c6ca05c-aed5-44af-8ddb-2050967e3d20 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:31.330211782 +0000 UTC m=+247.419535927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dld48" (UID: "9c6ca05c-aed5-44af-8ddb-2050967e3d20") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:30.404160 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.404126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" event={"ID":"fc5fdac8-1e13-4482-8396-39419138335a","Type":"ContainerStarted","Data":"0ff2ff90a435dfcdba418143fd7a3f3db957e5bffa2aba45758d695b4a6b1052"} Jul 06 19:09:30.405649 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.405623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt" event={"ID":"e0698c60-a88c-4bb7-9f8c-d992ee12ce74","Type":"ContainerStarted","Data":"df1dc6439e08cf10831f0a382582b2c14b867faf235601acf26cc73548b0c5ab"} Jul 06 19:09:30.405767 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.405665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt" event={"ID":"e0698c60-a88c-4bb7-9f8c-d992ee12ce74","Type":"ContainerStarted","Data":"e080fff5113643dac15b38a03fcca0ab12d29992dc513af0019e0c0b879ccefd"} Jul 06 19:09:30.406794 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.406772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm" event={"ID":"975c0e3a-dcea-44ba-b27e-d924b05a8338","Type":"ContainerStarted","Data":"e1df26415c7097afba3ae01690bec8ee6f09e4ef222d5c89f06c8e03ab2526ea"} Jul 06 19:09:30.424114 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:30.424043 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bb8gt" podStartSLOduration=1.424026314 podStartE2EDuration="1.424026314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:30.423719196 +0000 UTC m=+246.513043354" watchObservedRunningTime="2026-07-06 19:09:30.424026314 +0000 UTC m=+246.513350449" Jul 06 19:09:31.136330 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:31.136296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:31.136794 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.136415 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:09:31.136794 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.136495 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls podName:87a3cc9a-4ef9-4bde-b663-e507ba4c915a nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.13645699 +0000 UTC m=+249.225781130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mq992" (UID: "87a3cc9a-4ef9-4bde-b663-e507ba4c915a") : secret "samples-operator-tls" not found Jul 06 19:09:31.237043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:31.237005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:31.237043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:31.237051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:31.237265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.237145 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:09:31.237265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.237155 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:09:31.237265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.237176 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b56cf666-pvxft: secret "image-registry-tls" not found Jul 06 19:09:31.237265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.237199 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert podName:0e714f25-7037-4a04-89a5-aa1cefa14504 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.237183192 +0000 UTC m=+249.326507327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-d8728" (UID: "0e714f25-7037-4a04-89a5-aa1cefa14504") : secret "networking-console-plugin-cert" not found Jul 06 19:09:31.237265 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.237220 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls podName:4737cd7a-6e47-4b01-b952-266b99c5da84 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.237207698 +0000 UTC m=+249.326531833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls") pod "image-registry-8b56cf666-pvxft" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84") : secret "image-registry-tls" not found Jul 06 19:09:31.337881 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:31.337783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:31.338052 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.337912 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:31.338052 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:31.337976 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls podName:9c6ca05c-aed5-44af-8ddb-2050967e3d20 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.337959138 +0000 UTC m=+249.427283273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dld48" (UID: "9c6ca05c-aed5-44af-8ddb-2050967e3d20") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:31.411113 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:31.411077 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm" event={"ID":"975c0e3a-dcea-44ba-b27e-d924b05a8338","Type":"ContainerStarted","Data":"16853a53b1255e09c872cdb22f56bcd3fb1d61b109b0674c269fabd3729ca4fe"} Jul 06 19:09:31.429048 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:31.428998 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z4xtm" podStartSLOduration=1.3105942910000001 podStartE2EDuration="2.428978008s" totalImagesPullingTime="1.118383717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:31.428194663 +0000 UTC m=+247.517518821" watchObservedRunningTime="2026-07-06 19:09:31.428978008 +0000 UTC m=+247.518302186" Jul 06 19:09:31.588244 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:31.588154 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:31.648857 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:31.648815 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:32.415345 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:32.415265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" event={"ID":"fc5fdac8-1e13-4482-8396-39419138335a","Type":"ContainerStarted","Data":"1ffa251fe7e10f61aacd78783ae8e95555111acfbffcf751109f37b9a33c5aa3"} Jul 06 19:09:32.434946 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:32.434901 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" podStartSLOduration=1.359156819 podStartE2EDuration="3.434886753s" totalImagesPullingTime="2.075729934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:32.434004708 +0000 UTC m=+248.523328867" watchObservedRunningTime="2026-07-06 19:09:32.434886753 +0000 UTC m=+248.524210909" Jul 06 19:09:33.036359 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.036226 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5v4pd"] Jul 06 19:09:33.040955 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.040929 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.045108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.045088 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:09:33.047320 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.047288 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:09:33.048566 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.048542 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxdw6\"" Jul 06 19:09:33.102448 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.102419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:33.123536 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.123508 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5v4pd"] Jul 06 19:09:33.154678 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.154651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.154824 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.154688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.154824 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.154722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:33.154824 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.154786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9pxw\" (UniqueName: \"kubernetes.io/projected/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-api-access-m9pxw\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.154824 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.154819 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:09:33.155044 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.154875 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls podName:87a3cc9a-4ef9-4bde-b663-e507ba4c915a nodeName:}" failed. No retries permitted until 2026-07-06 19:09:37.15485698 +0000 UTC m=+253.244181116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mq992" (UID: "87a3cc9a-4ef9-4bde-b663-e507ba4c915a") : secret "samples-operator-tls" not found Jul 06 19:09:33.155044 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.154899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-crio-socket\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.155044 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.154943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-data-volume\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.176665 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.176637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:33.255937 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.255909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.255937 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.255937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.256091 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.255977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9pxw\" (UniqueName: \"kubernetes.io/projected/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-api-access-m9pxw\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.256091 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.256018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-crio-socket\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.256091 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256037 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:09:33.256091 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256059 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.256040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.256113 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-crio-socket\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256125 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.756105266 +0000 UTC m=+249.845429422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : configmap "kube-rbac-proxy" not found Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256159 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:33.756150445 +0000 UTC m=+249.845474587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : secret "insights-runtime-extractor-tls" not found Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.256178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-data-volume\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256237 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256247 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b56cf666-pvxft: secret "image-registry-tls" not found Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256291 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls podName:4737cd7a-6e47-4b01-b952-266b99c5da84 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:37.256275968 +0000 UTC m=+253.345600118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls") pod "image-registry-8b56cf666-pvxft" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84") : secret "image-registry-tls" not found Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.256306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256370 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:09:33.256405 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.256401 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert podName:0e714f25-7037-4a04-89a5-aa1cefa14504 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:37.256393472 +0000 UTC m=+253.345717607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-d8728" (UID: "0e714f25-7037-4a04-89a5-aa1cefa14504") : secret "networking-console-plugin-cert" not found Jul 06 19:09:33.256764 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.256438 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-data-volume\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.268925 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.268897 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9pxw\" (UniqueName: \"kubernetes.io/projected/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-api-access-m9pxw\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.357631 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.357546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:33.357770 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.357697 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:33.357770 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.357764 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls podName:9c6ca05c-aed5-44af-8ddb-2050967e3d20 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:37.357749962 +0000 UTC m=+253.447074101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dld48" (UID: "9c6ca05c-aed5-44af-8ddb-2050967e3d20") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:33.759502 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.759432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:33.760430 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.760409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.760549 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.760445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:33.760549 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.760530 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:09:33.760636 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.760591 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:34.760573137 +0000 UTC m=+250.849897273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : configmap "kube-rbac-proxy" not found Jul 06 19:09:33.760636 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.760624 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:09:33.760727 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:33.760664 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:34.760651642 +0000 UTC m=+250.849975785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : secret "insights-runtime-extractor-tls" not found Jul 06 19:09:33.782657 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.782633 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh"] Jul 06 19:09:33.784628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.784613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" Jul 06 19:09:33.787113 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.787094 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 19:09:33.787225 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.787125 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5g5kg\"" Jul 06 19:09:33.787671 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.787648 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 19:09:33.796850 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.796827 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh"] Jul 06 19:09:33.857190 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.857158 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:33.861890 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.861869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95nrn\" (UniqueName: \"kubernetes.io/projected/cf526b33-916b-4b16-9f1f-a2c1ccc96b4c-kube-api-access-95nrn\") pod \"migrator-d57d58cc9-hmzzh\" (UID: \"cf526b33-916b-4b16-9f1f-a2c1ccc96b4c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" Jul 06 19:09:33.963093 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.963055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95nrn\" (UniqueName: \"kubernetes.io/projected/cf526b33-916b-4b16-9f1f-a2c1ccc96b4c-kube-api-access-95nrn\") pod \"migrator-d57d58cc9-hmzzh\" (UID: \"cf526b33-916b-4b16-9f1f-a2c1ccc96b4c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" Jul 06 19:09:33.969863 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.969838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:33.975067 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:33.975045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95nrn\" (UniqueName: \"kubernetes.io/projected/cf526b33-916b-4b16-9f1f-a2c1ccc96b4c-kube-api-access-95nrn\") pod \"migrator-d57d58cc9-hmzzh\" (UID: \"cf526b33-916b-4b16-9f1f-a2c1ccc96b4c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" Jul 06 19:09:34.093445 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.093353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" Jul 06 19:09:34.220433 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.220407 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh"] Jul 06 19:09:34.222840 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:09:34.222816 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf526b33_916b_4b16_9f1f_a2c1ccc96b4c.slice/crio-a66a7f917152f7a9be9e3ee47e4821a92759d53c071f84729aba96aa40979264 WatchSource:0}: Error finding container a66a7f917152f7a9be9e3ee47e4821a92759d53c071f84729aba96aa40979264: Status 404 returned error can't find the container with id a66a7f917152f7a9be9e3ee47e4821a92759d53c071f84729aba96aa40979264 Jul 06 19:09:34.421576 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.421498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" event={"ID":"cf526b33-916b-4b16-9f1f-a2c1ccc96b4c","Type":"ContainerStarted","Data":"a66a7f917152f7a9be9e3ee47e4821a92759d53c071f84729aba96aa40979264"} Jul 06 19:09:34.511033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.511003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:34.579125 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.579095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:34.754586 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.754555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:34.769228 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.769192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:34.769619 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.769236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:34.769619 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:34.769313 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:09:34.769619 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:34.769369 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:36.769352487 +0000 UTC m=+252.858676622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : configmap "kube-rbac-proxy" not found Jul 06 19:09:34.769619 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:34.769402 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:09:34.769619 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:34.769451 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:36.769439977 +0000 UTC m=+252.858764116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : secret "insights-runtime-extractor-tls" not found Jul 06 19:09:34.856183 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:34.856146 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:35.197848 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:35.197772 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h5kp8_5f137841-b4b0-4311-9473-a155a6f320fe/dns-node-resolver/0.log" Jul 06 19:09:35.225531 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:35.225494 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:35.325742 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:35.325709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:35.794643 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:35.794617 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5z2tp_5efa33d4-4aab-46fb-a9e1-687e3d4b07ef/node-ca/0.log" Jul 06 19:09:36.382157 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.382125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:09:36.382346 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:36.382287 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:09:36.382395 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:36.382351 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs podName:b13928a4-8ea4-4208-b577-30710d00a7bd nodeName:}" failed. No retries permitted until 2026-07-06 19:11:38.382335936 +0000 UTC m=+374.471660074 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs") pod "network-metrics-daemon-vbkcv" (UID: "b13928a4-8ea4-4208-b577-30710d00a7bd") : secret "metrics-daemon-secret" not found Jul 06 19:09:36.428862 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.428827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" event={"ID":"cf526b33-916b-4b16-9f1f-a2c1ccc96b4c","Type":"ContainerStarted","Data":"27d3327e7d7097fc36fa7e38524d531ee108f730eca408cb8d255696b642b29e"} Jul 06 19:09:36.429028 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.428907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" event={"ID":"cf526b33-916b-4b16-9f1f-a2c1ccc96b4c","Type":"ContainerStarted","Data":"a37353696912ed00438874c9219d78244989384e8fd2e6fd77184ccc06bff722"} Jul 06 19:09:36.448376 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.448319 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-hmzzh" podStartSLOduration=1.870853044 podStartE2EDuration="3.448303482s" totalImagesPullingTime="1.577450438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:36.447281874 +0000 UTC m=+252.536606030" watchObservedRunningTime="2026-07-06 19:09:36.448303482 +0000 UTC m=+252.537627663" Jul 06 19:09:36.546670 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.546638 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:36.785209 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.785171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:36.785209 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.785208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:36.785444 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:36.785293 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:09:36.785444 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:36.785312 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:09:36.785444 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:36.785352 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:40.785337267 +0000 UTC m=+256.874661402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : configmap "kube-rbac-proxy" not found Jul 06 19:09:36.785444 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:36.785366 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:40.785360524 +0000 UTC m=+256.874684659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : secret "insights-runtime-extractor-tls" not found Jul 06 19:09:36.793554 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.793533 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nbhrc_05cabb41-49be-452e-b240-1447ec5b47bf/serve-healthcheck-canary/0.log" Jul 06 19:09:36.894021 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.893985 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:36.956723 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:36.956697 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:37.188855 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:37.188767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:37.189003 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.188922 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:09:37.189003 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.188995 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls podName:87a3cc9a-4ef9-4bde-b663-e507ba4c915a nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.188970673 +0000 UTC m=+261.278294808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mq992" (UID: "87a3cc9a-4ef9-4bde-b663-e507ba4c915a") : secret "samples-operator-tls" not found Jul 06 19:09:37.290017 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:37.289981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:37.290227 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:37.290117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:37.290227 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.290155 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:09:37.290346 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.290227 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:09:37.290346 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.290235 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert podName:0e714f25-7037-4a04-89a5-aa1cefa14504 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.29021593 +0000 UTC m=+261.379540072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-d8728" (UID: "0e714f25-7037-4a04-89a5-aa1cefa14504") : secret "networking-console-plugin-cert" not found Jul 06 19:09:37.290346 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.290239 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8b56cf666-pvxft: secret "image-registry-tls" not found Jul 06 19:09:37.290346 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.290279 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls podName:4737cd7a-6e47-4b01-b952-266b99c5da84 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.290265257 +0000 UTC m=+261.379589393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls") pod "image-registry-8b56cf666-pvxft" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84") : secret "image-registry-tls" not found Jul 06 19:09:37.390821 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:37.390784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:37.390989 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.390933 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:37.391034 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:37.390992 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls podName:9c6ca05c-aed5-44af-8ddb-2050967e3d20 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.390977951 +0000 UTC m=+261.480302088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dld48" (UID: "9c6ca05c-aed5-44af-8ddb-2050967e3d20") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:37.967617 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:37.967582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:39.370637 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:39.370601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:39.546059 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:39.546020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:39.640803 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:39.640717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:39.742076 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:39.742045 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:39.809218 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:39.809190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:40.053250 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:40.053216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:40.602157 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:40.602127 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:40.702651 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:40.702617 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:40.820047 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:40.820008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:40.820047 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:40.820044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:40.820260 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:40.820128 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:09:40.820260 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:40.820143 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:09:40.820260 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:40.820189 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:48.820174756 +0000 UTC m=+264.909498891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : configmap "kube-rbac-proxy" not found Jul 06 19:09:40.820260 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:40.820203 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:09:48.820197543 +0000 UTC m=+264.909521678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : secret "insights-runtime-extractor-tls" not found Jul 06 19:09:41.467684 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:41.467650 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:41.852072 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:41.851973 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:42.054411 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:42.054375 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:42.256667 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:42.256637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:42.459590 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:42.459545 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:43.300839 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:43.300809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:43.382840 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:43.382811 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:43.460381 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:43.460351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:43.864638 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:43.864601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:44.062407 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:44.062378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:44.280069 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:44.280038 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:44.460304 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:44.460269 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:44.530667 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:44.530595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:45.256102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.256065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:45.258402 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.258382 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/87a3cc9a-4ef9-4bde-b663-e507ba4c915a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mq992\" (UID: \"87a3cc9a-4ef9-4bde-b663-e507ba4c915a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:45.357096 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.357049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:45.357096 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.357100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:09:45.357361 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:45.357194 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:09:45.357361 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:45.357244 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert podName:0e714f25-7037-4a04-89a5-aa1cefa14504 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:01.357231441 +0000 UTC m=+277.446555575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-d8728" (UID: "0e714f25-7037-4a04-89a5-aa1cefa14504") : secret "networking-console-plugin-cert" not found Jul 06 19:09:45.359550 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.359527 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"image-registry-8b56cf666-pvxft\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:45.390738 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.390709 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" Jul 06 19:09:45.457614 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.457585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:09:45.457808 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:45.457756 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:45.457868 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:45.457831 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls podName:9c6ca05c-aed5-44af-8ddb-2050967e3d20 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:01.457810438 +0000 UTC m=+277.547134579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-dld48" (UID: "9c6ca05c-aed5-44af-8ddb-2050967e3d20") : secret "cluster-monitoring-operator-tls" not found Jul 06 19:09:45.473729 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.473701 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:45.478138 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.478117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:45.526933 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.526701 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992"] Jul 06 19:09:45.612736 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:45.612711 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8b56cf666-pvxft"] Jul 06 19:09:45.615296 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:09:45.615269 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4737cd7a_6e47_4b01_b952_266b99c5da84.slice/crio-e82d2bb998ff88d275c010a9212f53f487d6dea04a81408a18d3081e7e6c9ee3 WatchSource:0}: Error finding container e82d2bb998ff88d275c010a9212f53f487d6dea04a81408a18d3081e7e6c9ee3: Status 404 returned error can't find the container with id e82d2bb998ff88d275c010a9212f53f487d6dea04a81408a18d3081e7e6c9ee3 Jul 06 19:09:46.460481 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:46.460372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" event={"ID":"4737cd7a-6e47-4b01-b952-266b99c5da84","Type":"ContainerStarted","Data":"c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1"} Jul 06 19:09:46.460649 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:46.460554 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:09:46.460649 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:46.460598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" event={"ID":"4737cd7a-6e47-4b01-b952-266b99c5da84","Type":"ContainerStarted","Data":"e82d2bb998ff88d275c010a9212f53f487d6dea04a81408a18d3081e7e6c9ee3"} Jul 06 19:09:46.461603 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:46.461584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" event={"ID":"87a3cc9a-4ef9-4bde-b663-e507ba4c915a","Type":"ContainerStarted","Data":"35812cf689c742c01d257f1e86838c06ad86395655f651926a2c49258e8a65eb"} Jul 06 19:09:46.483436 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:46.483382 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" podStartSLOduration=17.483366503 podStartE2EDuration="17.483366503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:46.482539115 +0000 UTC m=+262.571863276" watchObservedRunningTime="2026-07-06 19:09:46.483366503 +0000 UTC m=+262.572690659" Jul 06 19:09:46.764636 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:46.764555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:46.866738 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:46.866705 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:47.270645 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:47.270582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:47.471414 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:47.471372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:48.057063 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.057031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:48.471457 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.471427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" event={"ID":"87a3cc9a-4ef9-4bde-b663-e507ba4c915a","Type":"ContainerStarted","Data":"ce1852b878cbd69a0d1eee03f517e0da010fa6a2bca5506c7628bce8d6a0c94c"} Jul 06 19:09:48.471644 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.471521 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" event={"ID":"87a3cc9a-4ef9-4bde-b663-e507ba4c915a","Type":"ContainerStarted","Data":"bf031815c0b25d8eaecd8c0b55d4149748dfed26fc374064441ba35efaee1f5d"} Jul 06 19:09:48.490326 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.490271 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mq992" podStartSLOduration=17.449229651 podStartE2EDuration="19.490254486s" totalImagesPullingTime="2.041024835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:48.489369715 +0000 UTC m=+264.578693867" watchObservedRunningTime="2026-07-06 19:09:48.490254486 +0000 UTC m=+264.579578643" Jul 06 19:09:48.664604 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.664574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:48.877073 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.876990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:48.885213 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.885182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:48.885213 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.885220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:48.885351 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:48.885312 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:09:48.885385 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:09:48.885363 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls podName:b2847708-9fe0-46d1-bd4e-a220ecf19e4b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:04.885350368 +0000 UTC m=+280.974674503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5v4pd" (UID: "b2847708-9fe0-46d1-bd4e-a220ecf19e4b") : secret "insights-runtime-extractor-tls" not found Jul 06 19:09:48.885727 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:48.885709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:09:49.267130 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:49.267099 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:49.458317 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:49.458284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:49.867385 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:49.867351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:50.071865 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:50.071816 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:09:50.149954 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:09:50.149847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:00.639482 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:00.639428 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8b56cf666-pvxft"] Jul 06 19:10:00.644195 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:00.644167 2581 patch_prober.go:28] interesting pod/image-registry-8b56cf666-pvxft container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 19:10:00.644345 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:00.644226 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" podUID="4737cd7a-6e47-4b01-b952-266b99c5da84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:10:00.749267 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:00.749234 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:00.844347 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:00.844318 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:01.380628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:01.380595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:10:01.382986 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:01.382965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e714f25-7037-4a04-89a5-aa1cefa14504-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d8728\" (UID: \"0e714f25-7037-4a04-89a5-aa1cefa14504\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:10:01.481851 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:01.481814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:10:01.484122 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:01.484099 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c6ca05c-aed5-44af-8ddb-2050967e3d20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-dld48\" (UID: \"9c6ca05c-aed5-44af-8ddb-2050967e3d20\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:10:01.670745 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:01.670657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" Jul 06 19:10:01.766050 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:01.766018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" Jul 06 19:10:01.849437 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:01.849402 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-d8728"] Jul 06 19:10:01.852950 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:01.852898 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e714f25_7037_4a04_89a5_aa1cefa14504.slice/crio-9784f4eb77f99510c0f109640c7f00b5f1fcfef29cb6ea0464028dc928a3fb6b WatchSource:0}: Error finding container 9784f4eb77f99510c0f109640c7f00b5f1fcfef29cb6ea0464028dc928a3fb6b: Status 404 returned error can't find the container with id 9784f4eb77f99510c0f109640c7f00b5f1fcfef29cb6ea0464028dc928a3fb6b Jul 06 19:10:01.913848 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:01.913816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48"] Jul 06 19:10:01.916596 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:01.916570 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6ca05c_aed5_44af_8ddb_2050967e3d20.slice/crio-b74fb0f74ec33f22e48781584841e1fec34bb8453f1bcf0f410fd0f15b415d55 WatchSource:0}: Error finding container b74fb0f74ec33f22e48781584841e1fec34bb8453f1bcf0f410fd0f15b415d55: Status 404 returned error can't find the container with id b74fb0f74ec33f22e48781584841e1fec34bb8453f1bcf0f410fd0f15b415d55 Jul 06 19:10:02.514840 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:02.514810 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" event={"ID":"0e714f25-7037-4a04-89a5-aa1cefa14504","Type":"ContainerStarted","Data":"9784f4eb77f99510c0f109640c7f00b5f1fcfef29cb6ea0464028dc928a3fb6b"} Jul 06 19:10:02.515925 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:02.515902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" event={"ID":"9c6ca05c-aed5-44af-8ddb-2050967e3d20","Type":"ContainerStarted","Data":"b74fb0f74ec33f22e48781584841e1fec34bb8453f1bcf0f410fd0f15b415d55"} Jul 06 19:10:03.520757 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:03.520723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" event={"ID":"0e714f25-7037-4a04-89a5-aa1cefa14504","Type":"ContainerStarted","Data":"fda6d0bb87453d94810cb6c6e09f429182bf961f8dc20df9b20258a921f90eb5"} Jul 06 19:10:03.729535 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:03.729496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:03.805325 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:03.805226 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:04.864940 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:04.864846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:04.909918 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:04.909875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:10:04.912233 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:04.912209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b2847708-9fe0-46d1-bd4e-a220ecf19e4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5v4pd\" (UID: \"b2847708-9fe0-46d1-bd4e-a220ecf19e4b\") " pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:10:05.094879 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.094821 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d8728" podStartSLOduration=34.742757098 podStartE2EDuration="36.094798938s" totalImagesPullingTime="1.35204184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:03.544401555 +0000 UTC m=+279.633725712" watchObservedRunningTime="2026-07-06 19:10:05.094798938 +0000 UTC m=+281.184123096" Jul 06 19:10:05.095754 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.095735 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46"] Jul 06 19:10:05.098050 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.098034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" Jul 06 19:10:05.106031 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.106009 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 19:10:05.106285 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.106270 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kg5rg\"" Jul 06 19:10:05.126908 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.126828 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46"] Jul 06 19:10:05.152646 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.152613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5v4pd" Jul 06 19:10:05.190882 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.190822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:05.212887 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.212846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9b88e2eb-480a-42c9-8aba-8a8c7fb7456c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4hj46\" (UID: \"9b88e2eb-480a-42c9-8aba-8a8c7fb7456c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" Jul 06 19:10:05.285846 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.285803 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:05.314363 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.314317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9b88e2eb-480a-42c9-8aba-8a8c7fb7456c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4hj46\" (UID: \"9b88e2eb-480a-42c9-8aba-8a8c7fb7456c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" Jul 06 19:10:05.316934 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.316901 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9b88e2eb-480a-42c9-8aba-8a8c7fb7456c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4hj46\" (UID: \"9b88e2eb-480a-42c9-8aba-8a8c7fb7456c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" Jul 06 19:10:05.345593 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.345553 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5v4pd"] Jul 06 19:10:05.348967 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:05.348940 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2847708_9fe0_46d1_bd4e_a220ecf19e4b.slice/crio-95218acd97b41b086f7897b2f55ed1fb8b745747e0d3837ed2928465821ae02c WatchSource:0}: Error finding container 95218acd97b41b086f7897b2f55ed1fb8b745747e0d3837ed2928465821ae02c: Status 404 returned error can't find the container with id 95218acd97b41b086f7897b2f55ed1fb8b745747e0d3837ed2928465821ae02c Jul 06 19:10:05.407034 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.406933 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" Jul 06 19:10:05.528283 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.528242 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" event={"ID":"9c6ca05c-aed5-44af-8ddb-2050967e3d20","Type":"ContainerStarted","Data":"76c693ec1aeddaafcc25f4738f1b9dddc6e004098bbf50e1f68386b36acddba5"} Jul 06 19:10:05.529343 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.529323 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5v4pd" event={"ID":"b2847708-9fe0-46d1-bd4e-a220ecf19e4b","Type":"ContainerStarted","Data":"95218acd97b41b086f7897b2f55ed1fb8b745747e0d3837ed2928465821ae02c"} Jul 06 19:10:05.550341 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.550305 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46"] Jul 06 19:10:05.553532 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:05.553501 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b88e2eb_480a_42c9_8aba_8a8c7fb7456c.slice/crio-4d61481e9c9255db37b27ae2820bf9bdbc41b503d30891f455a31e701c62b33a WatchSource:0}: Error finding container 4d61481e9c9255db37b27ae2820bf9bdbc41b503d30891f455a31e701c62b33a: Status 404 returned error can't find the container with id 4d61481e9c9255db37b27ae2820bf9bdbc41b503d30891f455a31e701c62b33a Jul 06 19:10:05.570959 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:05.570912 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-dld48" podStartSLOduration=33.991632169 podStartE2EDuration="36.570895486s" totalImagesPullingTime="2.579263317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:05.570014812 +0000 UTC m=+281.659338998" watchObservedRunningTime="2026-07-06 19:10:05.570895486 +0000 UTC m=+281.660219642" Jul 06 19:10:06.537415 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:06.536929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" event={"ID":"9b88e2eb-480a-42c9-8aba-8a8c7fb7456c","Type":"ContainerStarted","Data":"4d61481e9c9255db37b27ae2820bf9bdbc41b503d30891f455a31e701c62b33a"} Jul 06 19:10:07.201185 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:10:07.201100 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bgf9z" podUID="33b13a8a-5a99-4d9c-ac94-512a42898c15" Jul 06 19:10:07.541759 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:07.541723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" event={"ID":"9b88e2eb-480a-42c9-8aba-8a8c7fb7456c","Type":"ContainerStarted","Data":"0cd20c016a6a4383f262f21528842fa41a2ea7d6083ff3b316c237411d00855e"} Jul 06 19:10:07.542232 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:07.541792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgf9z" Jul 06 19:10:07.542232 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:07.542028 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" Jul 06 19:10:07.547242 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:07.547214 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" Jul 06 19:10:07.567109 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:07.567049 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4hj46" podStartSLOduration=1.1739271470000001 podStartE2EDuration="2.567031097s" totalImagesPullingTime="1.39310395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:07.564736525 +0000 UTC m=+283.654060683" watchObservedRunningTime="2026-07-06 19:10:07.567031097 +0000 UTC m=+283.656355255" Jul 06 19:10:08.149406 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:08.149375 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:08.244969 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:08.244900 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:08.440937 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:08.440856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:09.550353 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:09.550313 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5v4pd" event={"ID":"b2847708-9fe0-46d1-bd4e-a220ecf19e4b","Type":"ContainerStarted","Data":"fa584d475107e9b5982a63b8a9a750adb6f94c940f09ff67c961e9919a6c1812"} Jul 06 19:10:10.253610 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.253579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:10:10.255870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.255843 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b13a8a-5a99-4d9c-ac94-512a42898c15-metrics-tls\") pod \"dns-default-bgf9z\" (UID: \"33b13a8a-5a99-4d9c-ac94-512a42898c15\") " pod="openshift-dns/dns-default-bgf9z" Jul 06 19:10:10.546909 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.546834 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjqpd\"" Jul 06 19:10:10.552420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.552391 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgf9z" Jul 06 19:10:10.556600 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.556572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5v4pd" event={"ID":"b2847708-9fe0-46d1-bd4e-a220ecf19e4b","Type":"ContainerStarted","Data":"6bd50fec869ef83448c6db84f166511dd79710b0201fc68e1e0c2709d397e604"} Jul 06 19:10:10.648287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.648241 2581 patch_prober.go:28] interesting pod/image-registry-8b56cf666-pvxft container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 19:10:10.648451 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.648303 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" podUID="4737cd7a-6e47-4b01-b952-266b99c5da84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:10:10.717313 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.717284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgf9z"] Jul 06 19:10:10.721144 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:10.721112 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b13a8a_5a99_4d9c_ac94_512a42898c15.slice/crio-ab3571bb5f3d3e91bb4e05ab970096f839f0e1c2b761ec3be4927ce72e439dc4 WatchSource:0}: Error finding container ab3571bb5f3d3e91bb4e05ab970096f839f0e1c2b761ec3be4927ce72e439dc4: Status 404 returned error can't find the container with id ab3571bb5f3d3e91bb4e05ab970096f839f0e1c2b761ec3be4927ce72e439dc4 Jul 06 19:10:10.784204 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:10.784162 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:11.563681 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:11.563607 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgf9z" event={"ID":"33b13a8a-5a99-4d9c-ac94-512a42898c15","Type":"ContainerStarted","Data":"ab3571bb5f3d3e91bb4e05ab970096f839f0e1c2b761ec3be4927ce72e439dc4"} Jul 06 19:10:12.470999 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.470950 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:12.661871 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.661826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:12.709162 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.709121 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx"] Jul 06 19:10:12.712894 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.712868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.716544 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.716499 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g4n6n\"" Jul 06 19:10:12.716544 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.716520 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 19:10:12.716760 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.716547 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:10:12.716760 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.716651 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:10:12.726578 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.726522 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx"] Jul 06 19:10:12.739539 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.739508 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6p46m"] Jul 06 19:10:12.742918 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.742890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.746002 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.745972 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:10:12.746125 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.746068 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vp86h\"" Jul 06 19:10:12.746308 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.746292 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:10:12.746528 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.746509 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:10:12.764295 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.764270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:12.772356 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.772500 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e1b1892-97b6-46ac-8dc2-156f22319395-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.772500 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-textfile\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.772500 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-tls\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.772500 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cbb8272-31db-4f4e-9f8e-f579172db7ff-metrics-client-ca\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.772748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-sys\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.772748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9sjt\" (UniqueName: \"kubernetes.io/projected/0e1b1892-97b6-46ac-8dc2-156f22319395-kube-api-access-q9sjt\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.772748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.772748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-root\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.772748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5h27\" (UniqueName: \"kubernetes.io/projected/6cbb8272-31db-4f4e-9f8e-f579172db7ff-kube-api-access-b5h27\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.772748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-wtmp\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.772748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.772748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.772745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.860804 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.860758 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:12.873807 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.873778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.873807 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.873810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e1b1892-97b6-46ac-8dc2-156f22319395-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.873837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-textfile\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.873859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-tls\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.873890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cbb8272-31db-4f4e-9f8e-f579172db7ff-metrics-client-ca\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.873934 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-sys\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.873961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9sjt\" (UniqueName: \"kubernetes.io/projected/0e1b1892-97b6-46ac-8dc2-156f22319395-kube-api-access-q9sjt\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.873988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-root\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:10:12.874031 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 19:10:12.874033 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5h27\" (UniqueName: \"kubernetes.io/projected/6cbb8272-31db-4f4e-9f8e-f579172db7ff-kube-api-access-b5h27\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-wtmp\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:10:12.874097 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-tls podName:6cbb8272-31db-4f4e-9f8e-f579172db7ff nodeName:}" failed. No retries permitted until 2026-07-06 19:10:13.374079096 +0000 UTC m=+289.463403246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-tls") pod "node-exporter-6p46m" (UID: "6cbb8272-31db-4f4e-9f8e-f579172db7ff") : secret "node-exporter-tls" not found Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874210 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-wtmp\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-textfile\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874260 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-sys\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:10:12.874337 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:10:12.874387 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-tls podName:0e1b1892-97b6-46ac-8dc2-156f22319395 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:13.374369264 +0000 UTC m=+289.463693400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-k72qx" (UID: "0e1b1892-97b6-46ac-8dc2-156f22319395") : secret "openshift-state-metrics-tls" not found Jul 06 19:10:12.874514 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874426 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cbb8272-31db-4f4e-9f8e-f579172db7ff-root\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.875051 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874604 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cbb8272-31db-4f4e-9f8e-f579172db7ff-metrics-client-ca\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.875051 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874683 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e1b1892-97b6-46ac-8dc2-156f22319395-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.875051 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.874937 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.877090 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.877013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.877090 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.877030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.884866 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.884791 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5h27\" (UniqueName: \"kubernetes.io/projected/6cbb8272-31db-4f4e-9f8e-f579172db7ff-kube-api-access-b5h27\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:12.884990 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.884912 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9sjt\" (UniqueName: \"kubernetes.io/projected/0e1b1892-97b6-46ac-8dc2-156f22319395-kube-api-access-q9sjt\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:12.961705 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:12.961666 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.065903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.065882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.162679 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.162642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.295228 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.295201 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.379802 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.379720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:13.379802 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.379787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-tls\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:13.382062 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.382033 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cbb8272-31db-4f4e-9f8e-f579172db7ff-node-exporter-tls\") pod \"node-exporter-6p46m\" (UID: \"6cbb8272-31db-4f4e-9f8e-f579172db7ff\") " pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:13.382167 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.382139 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e1b1892-97b6-46ac-8dc2-156f22319395-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-k72qx\" (UID: \"0e1b1892-97b6-46ac-8dc2-156f22319395\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:13.392380 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.392334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.572207 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.572173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgf9z" event={"ID":"33b13a8a-5a99-4d9c-ac94-512a42898c15","Type":"ContainerStarted","Data":"81fee65d99b70309c6aed73275a5de00c389389df5cbcb857010dc98f8e1661e"} Jul 06 19:10:13.572359 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.572222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgf9z" event={"ID":"33b13a8a-5a99-4d9c-ac94-512a42898c15","Type":"ContainerStarted","Data":"fdb5fda8de8ad521bf367c8f1b2d685ccefa2a00a9d03bcd6fb067d50833c32d"} Jul 06 19:10:13.572359 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.572271 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bgf9z" Jul 06 19:10:13.574188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.574163 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5v4pd" event={"ID":"b2847708-9fe0-46d1-bd4e-a220ecf19e4b","Type":"ContainerStarted","Data":"9dde4780b5b94e96989d7a957c59cef6b37e86ba5fd56f4a2caba93c6145dd43"} Jul 06 19:10:13.597524 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.597478 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bgf9z" podStartSLOduration=251.266853459 podStartE2EDuration="4m13.597447997s" totalImagesPullingTime="2.330594538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:13.597426544 +0000 UTC m=+289.686750701" watchObservedRunningTime="2026-07-06 19:10:13.597447997 +0000 UTC m=+289.686772154" Jul 06 19:10:13.621443 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.621396 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5v4pd" podStartSLOduration=34.049843103 podStartE2EDuration="41.621381902s" totalImagesPullingTime="7.571538799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:13.620556101 +0000 UTC m=+289.709880262" watchObservedRunningTime="2026-07-06 19:10:13.621381902 +0000 UTC m=+289.710706059" Jul 06 19:10:13.625107 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.625082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" Jul 06 19:10:13.653857 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.653823 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6p46m" Jul 06 19:10:13.666163 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:13.666135 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbb8272_31db_4f4e_9f8e_f579172db7ff.slice/crio-1f62b63f1ced5d58b8dc67f2057467fdbce22e40f86122d9dc29e731ed957b66 WatchSource:0}: Error finding container 1f62b63f1ced5d58b8dc67f2057467fdbce22e40f86122d9dc29e731ed957b66: Status 404 returned error can't find the container with id 1f62b63f1ced5d58b8dc67f2057467fdbce22e40f86122d9dc29e731ed957b66 Jul 06 19:10:13.699268 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.699194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.787092 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.787068 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx"] Jul 06 19:10:13.789366 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:13.789341 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1b1892_97b6_46ac_8dc2_156f22319395.slice/crio-38a8dd345ab8c7530517e5c2c89cce5a191009d03825cc8fbc684f89dc09af1a WatchSource:0}: Error finding container 38a8dd345ab8c7530517e5c2c89cce5a191009d03825cc8fbc684f89dc09af1a: Status 404 returned error can't find the container with id 38a8dd345ab8c7530517e5c2c89cce5a191009d03825cc8fbc684f89dc09af1a Jul 06 19:10:13.821688 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.821659 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.832057 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.832035 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:13.838341 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.838315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.851394 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.851374 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gsbb4\"" Jul 06 19:10:13.851924 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.851647 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:10:13.851924 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.851717 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:10:13.851924 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.851722 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:10:13.851924 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.851650 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:10:13.851924 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.851859 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:10:13.852257 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.852185 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:10:13.852257 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.852191 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:10:13.852257 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.852239 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:10:13.852424 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.852186 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:10:13.866455 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.866413 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:13.884418 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884591 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884591 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-config-out\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884591 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884591 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884591 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884880 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-web-config\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884880 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884880 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qbp\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-kube-api-access-j6qbp\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884880 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884880 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884880 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-config-volume\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.884880 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.884817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.906815 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.906787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:13.985443 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qbp\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-kube-api-access-j6qbp\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.985640 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.985640 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.985640 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-config-volume\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.985803 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.985851 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.985904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.985904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-config-out\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.986013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.986013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985925 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.986013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.986013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.985984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.986198 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.986017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-web-config\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.986198 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.986058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.986389 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.986364 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.986689 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.986644 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.988817 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.988783 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-config-volume\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.989194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.989174 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.989709 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.989442 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.989709 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.989648 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.989709 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.989671 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.989709 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.989686 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.990206 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.990182 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-config-out\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.990832 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.990813 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.991148 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.991132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-web-config\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:13.996313 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:13.996290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qbp\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-kube-api-access-j6qbp\") pod \"alertmanager-main-0\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:14.147627 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.147530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:14.320523 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.320489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:14.324241 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:14.324209 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf247647f_d154_4c41_9e7f_13cd686ec241.slice/crio-ad3a61d7520217885fd475906633d5089fcf9bdba31b68bc289f80c74756339c WatchSource:0}: Error finding container ad3a61d7520217885fd475906633d5089fcf9bdba31b68bc289f80c74756339c: Status 404 returned error can't find the container with id ad3a61d7520217885fd475906633d5089fcf9bdba31b68bc289f80c74756339c Jul 06 19:10:14.580143 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.580102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerStarted","Data":"ad3a61d7520217885fd475906633d5089fcf9bdba31b68bc289f80c74756339c"} Jul 06 19:10:14.581696 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.581662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p46m" event={"ID":"6cbb8272-31db-4f4e-9f8e-f579172db7ff","Type":"ContainerStarted","Data":"1f62b63f1ced5d58b8dc67f2057467fdbce22e40f86122d9dc29e731ed957b66"} Jul 06 19:10:14.583920 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.583889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" event={"ID":"0e1b1892-97b6-46ac-8dc2-156f22319395","Type":"ContainerStarted","Data":"1365a29dde7ea2857e64000a9e403b2235d507a557eafba9295ef62abad24cc3"} Jul 06 19:10:14.584053 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.583944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" event={"ID":"0e1b1892-97b6-46ac-8dc2-156f22319395","Type":"ContainerStarted","Data":"d2e5f4f81c54ad4ca17c4dfc8b7c89f892a349439cdd1700adbf1b9d3b715e09"} Jul 06 19:10:14.584053 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.583974 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" event={"ID":"0e1b1892-97b6-46ac-8dc2-156f22319395","Type":"ContainerStarted","Data":"38a8dd345ab8c7530517e5c2c89cce5a191009d03825cc8fbc684f89dc09af1a"} Jul 06 19:10:14.831505 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.831382 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cf4594746-qwhvg"] Jul 06 19:10:14.835439 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.835413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.839348 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.839323 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 19:10:14.839348 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.839341 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 19:10:14.839580 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.839411 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 19:10:14.839580 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.839424 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 19:10:14.839580 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.839437 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 19:10:14.839699 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.839631 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k94lz\"" Jul 06 19:10:14.839737 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.839719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-36g7d6fbpe0cj\"" Jul 06 19:10:14.854649 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.854621 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cf4594746-qwhvg"] Jul 06 19:10:14.894410 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.894379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-metrics-client-ca\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.894592 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.894430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.894592 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.894513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-grpc-tls\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.894592 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.894539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.894686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.894620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-tls\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.894686 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.894651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czhks\" (UniqueName: \"kubernetes.io/projected/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-kube-api-access-czhks\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.894748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.894686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.894748 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.894725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.906002 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.905975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:14.983188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.983147 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:14.996001 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.995964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-tls\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.996188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.996013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhks\" (UniqueName: \"kubernetes.io/projected/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-kube-api-access-czhks\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.996188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.996057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.996188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.996112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.996188 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.996150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-metrics-client-ca\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.996403 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.996196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.996403 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.996238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-grpc-tls\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.996403 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.996271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.997077 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.997050 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-metrics-client-ca\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.999446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.999422 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-tls\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:14.999928 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.999882 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:15.000028 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:14.999946 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-grpc-tls\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:15.000326 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.000286 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:15.000557 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.000528 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:15.000643 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.000566 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:15.005990 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.005971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czhks\" (UniqueName: \"kubernetes.io/projected/64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73-kube-api-access-czhks\") pod \"thanos-querier-cf4594746-qwhvg\" (UID: \"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73\") " pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:15.082262 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.082175 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:15.145497 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.145441 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:15.183542 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.183484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:15.284132 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.284090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:15.373439 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.373354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:15.452673 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.452631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:15.591018 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.590933 2581 generic.go:356] "Generic (PLEG): container finished" podID="6cbb8272-31db-4f4e-9f8e-f579172db7ff" containerID="2827f086791b3d13db1cd404427d72097afa7624987843207cbadc440b4bb64f" exitCode=0 Jul 06 19:10:15.591140 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.591037 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p46m" event={"ID":"6cbb8272-31db-4f4e-9f8e-f579172db7ff","Type":"ContainerDied","Data":"2827f086791b3d13db1cd404427d72097afa7624987843207cbadc440b4bb64f"} Jul 06 19:10:15.690116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.690091 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cf4594746-qwhvg"] Jul 06 19:10:15.700983 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:15.700956 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fbca87_ef1f_4d1f_ba9f_9fa67ec6bf73.slice/crio-d4119cc299b8ccd59949524fc0a6507f9853232ff91172205ee935f422999e38 WatchSource:0}: Error finding container d4119cc299b8ccd59949524fc0a6507f9853232ff91172205ee935f422999e38: Status 404 returned error can't find the container with id d4119cc299b8ccd59949524fc0a6507f9853232ff91172205ee935f422999e38 Jul 06 19:10:15.771304 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.771283 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:15.871147 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.871117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:15.989661 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:15.989623 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:16.088384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.088355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:16.196618 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.196589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:16.597974 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.597932 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" event={"ID":"0e1b1892-97b6-46ac-8dc2-156f22319395","Type":"ContainerStarted","Data":"07efc9381c4900e31009bd51b3d84aa7a367501cf813057fad1fd4475b22f647"} Jul 06 19:10:16.599589 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.599562 2581 generic.go:356] "Generic (PLEG): container finished" podID="f247647f-d154-4c41-9e7f-13cd686ec241" containerID="24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34" exitCode=0 Jul 06 19:10:16.599727 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.599652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerDied","Data":"24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34"} Jul 06 19:10:16.601961 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.601922 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p46m" event={"ID":"6cbb8272-31db-4f4e-9f8e-f579172db7ff","Type":"ContainerStarted","Data":"6f65bf2fd22ca0ade9b79e1a78e0b242c7775a587c1cedc0be86ce699115a913"} Jul 06 19:10:16.602059 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.601972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6p46m" event={"ID":"6cbb8272-31db-4f4e-9f8e-f579172db7ff","Type":"ContainerStarted","Data":"2c19efeb8c17a6f8cbba20f98791a5040134f92c88fff297ed218fb93ca32694"} Jul 06 19:10:16.603340 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.603305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" event={"ID":"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73","Type":"ContainerStarted","Data":"d4119cc299b8ccd59949524fc0a6507f9853232ff91172205ee935f422999e38"} Jul 06 19:10:16.678241 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.678179 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-k72qx" podStartSLOduration=3.094816814 podStartE2EDuration="4.678156527s" totalImagesPullingTime="1.583339713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:16.635966817 +0000 UTC m=+292.725291000" watchObservedRunningTime="2026-07-06 19:10:16.678156527 +0000 UTC m=+292.767480684" Jul 06 19:10:16.718199 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.718124 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6p46m" podStartSLOduration=3.607858051 podStartE2EDuration="4.718110243s" totalImagesPullingTime="1.037278767s" totalInitContainerRuntime="72.973425ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:16.717864891 +0000 UTC m=+292.807189048" watchObservedRunningTime="2026-07-06 19:10:16.718110243 +0000 UTC m=+292.807434400" Jul 06 19:10:16.794737 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.794695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:16.996724 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:16.996694 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:17.192624 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.192583 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c988ddcc4-jcvbx"] Jul 06 19:10:17.196439 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.196413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.199682 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.199656 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 19:10:17.199814 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.199678 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 19:10:17.199814 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.199775 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 19:10:17.199920 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.199666 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-m7zqx\"" Jul 06 19:10:17.201957 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.201903 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bhqqqsbl2qhdn\"" Jul 06 19:10:17.205893 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.205387 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:10:17.216762 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.216732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrspd\" (UniqueName: \"kubernetes.io/projected/728151cc-42cf-4579-b6e0-b01ce8a3a938-kube-api-access-mrspd\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.216918 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.216781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/728151cc-42cf-4579-b6e0-b01ce8a3a938-metrics-server-audit-profiles\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.216918 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.216853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/728151cc-42cf-4579-b6e0-b01ce8a3a938-audit-log\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.217030 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.216921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-secret-metrics-server-client-certs\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.217030 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.216956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728151cc-42cf-4579-b6e0-b01ce8a3a938-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.217149 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.217031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-secret-metrics-server-tls\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.217149 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.217054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-client-ca-bundle\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.224518 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.224487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:17.225975 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.225951 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c988ddcc4-jcvbx"] Jul 06 19:10:17.319236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.318491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-secret-metrics-server-client-certs\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.319236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.318536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728151cc-42cf-4579-b6e0-b01ce8a3a938-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.319236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.318599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-secret-metrics-server-tls\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.319236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.318622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-client-ca-bundle\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.319236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.318666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrspd\" (UniqueName: \"kubernetes.io/projected/728151cc-42cf-4579-b6e0-b01ce8a3a938-kube-api-access-mrspd\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.319236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.318704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/728151cc-42cf-4579-b6e0-b01ce8a3a938-metrics-server-audit-profiles\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.319236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.318769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/728151cc-42cf-4579-b6e0-b01ce8a3a938-audit-log\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.319236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.319118 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/728151cc-42cf-4579-b6e0-b01ce8a3a938-audit-log\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.319905 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.319877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728151cc-42cf-4579-b6e0-b01ce8a3a938-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.320250 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.320198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/728151cc-42cf-4579-b6e0-b01ce8a3a938-metrics-server-audit-profiles\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.321972 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.321946 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-client-ca-bundle\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.322566 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.322544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-secret-metrics-server-tls\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.322925 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.322905 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/728151cc-42cf-4579-b6e0-b01ce8a3a938-secret-metrics-server-client-certs\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.331687 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.331654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrspd\" (UniqueName: \"kubernetes.io/projected/728151cc-42cf-4579-b6e0-b01ce8a3a938-kube-api-access-mrspd\") pod \"metrics-server-7c988ddcc4-jcvbx\" (UID: \"728151cc-42cf-4579-b6e0-b01ce8a3a938\") " pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.487133 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.487094 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:17.509520 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.509493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:17.618804 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.618727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:17.735323 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:17.735286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:18.017113 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.017076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:18.092723 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.092686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:18.464730 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.464686 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c988ddcc4-jcvbx"] Jul 06 19:10:18.466408 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:18.466365 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728151cc_42cf_4579_b6e0_b01ce8a3a938.slice/crio-87c4eb448d59a9762ae53aad833be0d001fec9ad257cf4c66eef10946dc15ed2 WatchSource:0}: Error finding container 87c4eb448d59a9762ae53aad833be0d001fec9ad257cf4c66eef10946dc15ed2: Status 404 returned error can't find the container with id 87c4eb448d59a9762ae53aad833be0d001fec9ad257cf4c66eef10946dc15ed2 Jul 06 19:10:18.615211 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.615168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" event={"ID":"728151cc-42cf-4579-b6e0-b01ce8a3a938","Type":"ContainerStarted","Data":"87c4eb448d59a9762ae53aad833be0d001fec9ad257cf4c66eef10946dc15ed2"} Jul 06 19:10:18.619485 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.619437 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerStarted","Data":"8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b"} Jul 06 19:10:18.619586 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.619536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerStarted","Data":"32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f"} Jul 06 19:10:18.619586 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.619579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerStarted","Data":"ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685"} Jul 06 19:10:18.619690 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.619619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerStarted","Data":"43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a"} Jul 06 19:10:18.622321 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.622297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" event={"ID":"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73","Type":"ContainerStarted","Data":"153352fe083715688e6efcf315af4d6dbd5c3bcba131293155005c4f84bfb9bf"} Jul 06 19:10:18.622412 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.622385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" event={"ID":"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73","Type":"ContainerStarted","Data":"d783941acc86c6c78ab5d6b2527d1d79b4ec65d8db511a3013a19f96ec0dedf1"} Jul 06 19:10:18.622507 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:18.622427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" event={"ID":"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73","Type":"ContainerStarted","Data":"d78fd2e41b4f3debbbf8a4f1e1258fc5f80967d05332474124b660a68815cccc"} Jul 06 19:10:19.105385 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.105350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:19.106559 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.106528 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:19.111091 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.111069 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.121148 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.121119 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:10:19.121289 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.121270 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:10:19.121867 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.121817 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:10:19.122013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.121986 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:10:19.122429 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.122410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:10:19.122768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.122750 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:10:19.122849 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.122790 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:10:19.126616 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.126365 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:10:19.126616 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.126410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:10:19.126616 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.126586 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:10:19.128376 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.128337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:10:19.129116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.129097 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:10:19.129262 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.129147 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rl8b2\"" Jul 06 19:10:19.129262 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.129213 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:10:19.129262 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.129213 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c8egq529croji\"" Jul 06 19:10:19.134120 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.134095 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:10:19.136453 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136411 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:19.136689 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-config-out\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136791 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136791 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136791 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136944 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136944 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136944 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136944 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136944 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.136944 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.136985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.137021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-web-config\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.137056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x42lf\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-kube-api-access-x42lf\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.137101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.137132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-config\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.137204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.137288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.137314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.137532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.137411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238393 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238393 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238648 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-web-config\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238648 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238459 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x42lf\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-kube-api-access-x42lf\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238648 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238648 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-config\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238648 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238648 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238943 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238943 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238943 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-config-out\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238943 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.238943 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.238800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239247 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239123 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239489 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.239787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.239737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.240281 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.240013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.240281 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.240029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.240546 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.240522 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.240890 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.240864 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.241072 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.241046 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.242599 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.242572 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.242733 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.242696 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.243562 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.243539 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.243640 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.243544 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.243640 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.243628 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-config-out\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.244208 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.244183 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-web-config\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.244293 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.244229 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.244773 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.244754 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-config\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.245076 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.245051 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.245200 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.245185 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.245589 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.245569 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.245761 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.245742 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.249979 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.249959 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x42lf\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-kube-api-access-x42lf\") pod \"prometheus-k8s-0\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.424573 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.424519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:19.604923 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.604894 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:19.607094 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:10:19.607053 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4631316b_2466_4b65_b46e_a1711e650810.slice/crio-76c0d0951c9f3806cfb657b111f95853aa0147b20c7d894b42b150a453c8dcfc WatchSource:0}: Error finding container 76c0d0951c9f3806cfb657b111f95853aa0147b20c7d894b42b150a453c8dcfc: Status 404 returned error can't find the container with id 76c0d0951c9f3806cfb657b111f95853aa0147b20c7d894b42b150a453c8dcfc Jul 06 19:10:19.631806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.631721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" event={"ID":"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73","Type":"ContainerStarted","Data":"bdb038433f8100d8c6da879a61573296e4e842e72d8d9c765f5e7f4af08a3309"} Jul 06 19:10:19.631806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.631783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" event={"ID":"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73","Type":"ContainerStarted","Data":"abf2b3c92b5279e199b43c89ae360b7dffe639eee964af22df9f07395074fe01"} Jul 06 19:10:19.631806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.631809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" event={"ID":"64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73","Type":"ContainerStarted","Data":"dd51a1cf8f76a11b144aa9a43049e41f12b33694e923fa330515595a2f5f0b7e"} Jul 06 19:10:19.632054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.631924 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:19.633336 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.633300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerStarted","Data":"76c0d0951c9f3806cfb657b111f95853aa0147b20c7d894b42b150a453c8dcfc"} Jul 06 19:10:19.638573 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.638493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerStarted","Data":"06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed"} Jul 06 19:10:19.638573 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.638545 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerStarted","Data":"1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287"} Jul 06 19:10:19.695237 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.695177 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.046637182 podStartE2EDuration="6.69514897s" totalImagesPullingTime="3.617859403s" totalInitContainerRuntime="30.652385ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:19.693019217 +0000 UTC m=+295.782343374" watchObservedRunningTime="2026-07-06 19:10:19.69514897 +0000 UTC m=+295.784473128" Jul 06 19:10:19.696255 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:19.696216 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" podStartSLOduration=2.278454129 podStartE2EDuration="5.69619699s" totalImagesPullingTime="3.417742861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:19.66004339 +0000 UTC m=+295.749367548" watchObservedRunningTime="2026-07-06 19:10:19.69619699 +0000 UTC m=+295.785521148" Jul 06 19:10:20.644510 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:20.644415 2581 patch_prober.go:28] interesting pod/image-registry-8b56cf666-pvxft container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 19:10:20.644510 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:20.644489 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" podUID="4737cd7a-6e47-4b01-b952-266b99c5da84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:10:20.644953 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:20.644509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerDied","Data":"794fcbc8b17badd661011c201022bee42e476364ce69fb1a51c2b7ab9d1ae753"} Jul 06 19:10:20.644953 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:20.644486 2581 generic.go:356] "Generic (PLEG): container finished" podID="4631316b-2466-4b65-b46e-a1711e650810" containerID="794fcbc8b17badd661011c201022bee42e476364ce69fb1a51c2b7ab9d1ae753" exitCode=0 Jul 06 19:10:20.646227 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:20.646200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" event={"ID":"728151cc-42cf-4579-b6e0-b01ce8a3a938","Type":"ContainerStarted","Data":"2fe6c60d914efde43da94ba9a0666669e36e2cc1eeed9e006de0090ee1bea96f"} Jul 06 19:10:20.699223 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:20.699169 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" podStartSLOduration=1.9015426180000001 podStartE2EDuration="3.699143933s" totalImagesPullingTime="1.797601315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:20.698457852 +0000 UTC m=+296.787782008" watchObservedRunningTime="2026-07-06 19:10:20.699143933 +0000 UTC m=+296.788468090" Jul 06 19:10:20.711770 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:10:20.711733 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vbkcv" podUID="b13928a4-8ea4-4208-b577-30710d00a7bd" Jul 06 19:10:20.795014 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:20.794983 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:23.211168 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:23.211114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:23.586643 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:23.586559 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bgf9z" Jul 06 19:10:24.839742 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:24.835258 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:10:25.653146 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.653117 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cf4594746-qwhvg" Jul 06 19:10:25.658897 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.658869 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" podUID="4737cd7a-6e47-4b01-b952-266b99c5da84" containerName="registry" containerID="cri-o://c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1" gracePeriod=30 Jul 06 19:10:25.670216 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.670193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerStarted","Data":"c9762437d620232a973d12440fce77759f5f2cf3ab912ab1d422afb2db2364d2"} Jul 06 19:10:25.670310 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.670249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerStarted","Data":"72fe7ce43e17722aae7df97667a4938afc3172dd8060cec98a73bdfca51041a3"} Jul 06 19:10:25.670310 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.670274 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerStarted","Data":"0901fa9d100f76834b86f431997169267dc625b6168dd1fe498c2a67e0ce6e2a"} Jul 06 19:10:25.670310 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.670302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerStarted","Data":"e09a256409a379b06ff1b354f94435df8ac54e53a0ad60cb6bbe449539c9c910"} Jul 06 19:10:25.670408 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.670326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerStarted","Data":"9621a9ae944637f4a31aa68efbc55df71384df7c0163265809debe9fc9a0e5e7"} Jul 06 19:10:25.670408 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.670348 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerStarted","Data":"8e5b32e61bec73109369c151959150a299cba7239eed867778feebcf31fca789"} Jul 06 19:10:25.736122 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.736061 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.541824986 podStartE2EDuration="6.736038092s" totalImagesPullingTime="4.171111549s" totalInitContainerRuntime="23.101557ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:25.734405221 +0000 UTC m=+301.823729416" watchObservedRunningTime="2026-07-06 19:10:25.736038092 +0000 UTC m=+301.825362251" Jul 06 19:10:25.903609 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:25.903542 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:10:26.009860 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.009827 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-certificates\") pod \"4737cd7a-6e47-4b01-b952-266b99c5da84\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " Jul 06 19:10:26.009860 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.009861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-trusted-ca\") pod \"4737cd7a-6e47-4b01-b952-266b99c5da84\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " Jul 06 19:10:26.010116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.009882 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hc2q\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-kube-api-access-9hc2q\") pod \"4737cd7a-6e47-4b01-b952-266b99c5da84\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " Jul 06 19:10:26.010116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.009943 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-installation-pull-secrets\") pod \"4737cd7a-6e47-4b01-b952-266b99c5da84\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " Jul 06 19:10:26.010116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.009978 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-bound-sa-token\") pod \"4737cd7a-6e47-4b01-b952-266b99c5da84\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " Jul 06 19:10:26.010116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.010008 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") pod \"4737cd7a-6e47-4b01-b952-266b99c5da84\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " Jul 06 19:10:26.010116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.010033 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-image-registry-private-configuration\") pod \"4737cd7a-6e47-4b01-b952-266b99c5da84\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " Jul 06 19:10:26.010116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.010080 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4737cd7a-6e47-4b01-b952-266b99c5da84-ca-trust-extracted\") pod \"4737cd7a-6e47-4b01-b952-266b99c5da84\" (UID: \"4737cd7a-6e47-4b01-b952-266b99c5da84\") " Jul 06 19:10:26.010413 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.010337 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4737cd7a-6e47-4b01-b952-266b99c5da84" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:26.010838 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.010807 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4737cd7a-6e47-4b01-b952-266b99c5da84" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:26.012453 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.012408 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4737cd7a-6e47-4b01-b952-266b99c5da84" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:10:26.012453 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.012426 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-kube-api-access-9hc2q" (OuterVolumeSpecName: "kube-api-access-9hc2q") pod "4737cd7a-6e47-4b01-b952-266b99c5da84" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84"). InnerVolumeSpecName "kube-api-access-9hc2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:10:26.012667 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.012500 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4737cd7a-6e47-4b01-b952-266b99c5da84" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:26.012667 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.012654 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4737cd7a-6e47-4b01-b952-266b99c5da84" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:10:26.012886 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.012862 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4737cd7a-6e47-4b01-b952-266b99c5da84" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:26.018581 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.018560 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4737cd7a-6e47-4b01-b952-266b99c5da84-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4737cd7a-6e47-4b01-b952-266b99c5da84" (UID: "4737cd7a-6e47-4b01-b952-266b99c5da84"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:10:26.110903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.110868 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-installation-pull-secrets\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:10:26.110903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.110897 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-bound-sa-token\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:10:26.110903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.110907 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:10:26.111130 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.110916 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4737cd7a-6e47-4b01-b952-266b99c5da84-image-registry-private-configuration\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:10:26.111130 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.110925 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4737cd7a-6e47-4b01-b952-266b99c5da84-ca-trust-extracted\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:10:26.111130 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.110935 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-registry-certificates\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:10:26.111130 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.110945 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4737cd7a-6e47-4b01-b952-266b99c5da84-trusted-ca\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:10:26.111130 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.110954 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hc2q\" (UniqueName: \"kubernetes.io/projected/4737cd7a-6e47-4b01-b952-266b99c5da84-kube-api-access-9hc2q\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:10:26.675771 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.675735 2581 generic.go:356] "Generic (PLEG): container finished" podID="4737cd7a-6e47-4b01-b952-266b99c5da84" containerID="c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1" exitCode=0 Jul 06 19:10:26.675942 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.675779 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" Jul 06 19:10:26.675942 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.675822 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" event={"ID":"4737cd7a-6e47-4b01-b952-266b99c5da84","Type":"ContainerDied","Data":"c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1"} Jul 06 19:10:26.675942 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.675869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8b56cf666-pvxft" event={"ID":"4737cd7a-6e47-4b01-b952-266b99c5da84","Type":"ContainerDied","Data":"e82d2bb998ff88d275c010a9212f53f487d6dea04a81408a18d3081e7e6c9ee3"} Jul 06 19:10:26.675942 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.675889 2581 scope.go:117] "RemoveContainer" containerID="c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1" Jul 06 19:10:26.684629 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.684614 2581 scope.go:117] "RemoveContainer" containerID="c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1" Jul 06 19:10:26.684893 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:10:26.684875 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1\": container with ID starting with c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1 not found: ID does not exist" containerID="c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1" Jul 06 19:10:26.684955 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.684908 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1"} err="failed to get container status \"c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1\": rpc error: code = NotFound desc = could not find container \"c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1\": container with ID starting with c07041e8900720b58dd2c2f8ad79ae04d28502cf0b5a1445b4416920b03ee2a1 not found: ID does not exist" Jul 06 19:10:26.707195 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.707169 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8b56cf666-pvxft"] Jul 06 19:10:26.714980 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:26.714960 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8b56cf666-pvxft"] Jul 06 19:10:28.716506 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:28.716454 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4737cd7a-6e47-4b01-b952-266b99c5da84" path="/var/lib/kubelet/pods/4737cd7a-6e47-4b01-b952-266b99c5da84/volumes" Jul 06 19:10:29.424937 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:29.424906 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:30.060692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:30.060656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:30.156881 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:30.156850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:31.038953 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:31.038915 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:31.130649 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:31.130616 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:31.899319 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:31.899288 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:31.963722 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:31.963686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:32.194893 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:32.194819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:32.298646 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:32.298611 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:32.847674 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:32.847635 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:32.940540 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:32.940506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:33.066682 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:33.066653 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:33.176022 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:33.175946 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:33.710398 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:33.710370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:10:37.510548 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:37.510512 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:37.511019 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:37.510603 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:37.868318 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:37.868237 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:37.968948 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:37.968918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:40.101251 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:40.101214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:40.200639 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:40.200600 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:43.264800 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:43.264765 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:43.361423 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:43.361392 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:47.202172 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:47.202124 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:47.307396 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:47.307365 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:50.131594 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:50.131563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:50.205315 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:50.205277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:10:52.781375 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:52.781342 2581 generic.go:356] "Generic (PLEG): container finished" podID="fc5fdac8-1e13-4482-8396-39419138335a" containerID="1ffa251fe7e10f61aacd78783ae8e95555111acfbffcf751109f37b9a33c5aa3" exitCode=0 Jul 06 19:10:52.781766 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:52.781418 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" event={"ID":"fc5fdac8-1e13-4482-8396-39419138335a","Type":"ContainerDied","Data":"1ffa251fe7e10f61aacd78783ae8e95555111acfbffcf751109f37b9a33c5aa3"} Jul 06 19:10:52.781806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:52.781796 2581 scope.go:117] "RemoveContainer" containerID="1ffa251fe7e10f61aacd78783ae8e95555111acfbffcf751109f37b9a33c5aa3" Jul 06 19:10:53.310282 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:53.310250 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nbhrc_05cabb41-49be-452e-b240-1447ec5b47bf/serve-healthcheck-canary/0.log" Jul 06 19:10:53.788733 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:53.788698 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rb7xt" event={"ID":"fc5fdac8-1e13-4482-8396-39419138335a","Type":"ContainerStarted","Data":"b64ce26a4cad667f0c1507c9b7c45a71b8cea80ef735b80e116f6746c3e3298f"} Jul 06 19:10:57.515158 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:57.515126 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:10:57.518966 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:10:57.518942 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c988ddcc4-jcvbx" Jul 06 19:11:05.164487 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:05.164388 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:05.252788 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:05.252754 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:11.911193 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:11.911153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:12.032601 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:12.032565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:12.127597 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:12.127567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:19.425256 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:19.425159 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:19.444609 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:19.444580 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:19.920329 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:19.920303 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:32.274912 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:32.274875 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:32.576542 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:32.576417 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:33.297926 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.297879 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:33.298344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.298158 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="alertmanager" containerID="cri-o://43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a" gracePeriod=120 Jul 06 19:11:33.298344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.298219 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy-metric" containerID="cri-o://1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287" gracePeriod=120 Jul 06 19:11:33.298344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.298292 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy-web" containerID="cri-o://32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f" gracePeriod=120 Jul 06 19:11:33.298344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.298292 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="config-reloader" containerID="cri-o://ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685" gracePeriod=120 Jul 06 19:11:33.298344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.298318 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy" containerID="cri-o://8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b" gracePeriod=120 Jul 06 19:11:33.298638 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.298279 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="prom-label-proxy" containerID="cri-o://06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed" gracePeriod=120 Jul 06 19:11:33.965703 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965673 2581 generic.go:356] "Generic (PLEG): container finished" podID="f247647f-d154-4c41-9e7f-13cd686ec241" containerID="06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed" exitCode=0 Jul 06 19:11:33.965703 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965697 2581 generic.go:356] "Generic (PLEG): container finished" podID="f247647f-d154-4c41-9e7f-13cd686ec241" containerID="1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287" exitCode=0 Jul 06 19:11:33.965703 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965705 2581 generic.go:356] "Generic (PLEG): container finished" podID="f247647f-d154-4c41-9e7f-13cd686ec241" containerID="8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b" exitCode=0 Jul 06 19:11:33.965703 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965711 2581 generic.go:356] "Generic (PLEG): container finished" podID="f247647f-d154-4c41-9e7f-13cd686ec241" containerID="ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685" exitCode=0 Jul 06 19:11:33.965964 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965716 2581 generic.go:356] "Generic (PLEG): container finished" podID="f247647f-d154-4c41-9e7f-13cd686ec241" containerID="43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a" exitCode=0 Jul 06 19:11:33.965964 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerDied","Data":"06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed"} Jul 06 19:11:33.965964 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerDied","Data":"1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287"} Jul 06 19:11:33.965964 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerDied","Data":"8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b"} Jul 06 19:11:33.965964 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerDied","Data":"ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685"} Jul 06 19:11:33.965964 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:33.965897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerDied","Data":"43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a"} Jul 06 19:11:34.553719 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.553694 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:34.727623 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727595 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.727806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727633 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-config-volume\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.727806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727650 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-web-config\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.727806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727666 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-metrics-client-ca\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.727806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727686 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-trusted-ca-bundle\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.727806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727710 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-cluster-tls-config\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.728109 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727821 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-main-tls\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.728109 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727921 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-web\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.728109 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727948 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-main-db\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.728109 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.727990 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.728109 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.728015 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6qbp\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-kube-api-access-j6qbp\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.728109 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.728041 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-tls-assets\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.728109 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.728066 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-config-out\") pod \"f247647f-d154-4c41-9e7f-13cd686ec241\" (UID: \"f247647f-d154-4c41-9e7f-13cd686ec241\") " Jul 06 19:11:34.728452 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.728185 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:34.728452 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.728318 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:34.728452 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.728361 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.730704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.730674 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-config-volume" (OuterVolumeSpecName: "config-volume") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:34.730971 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.730935 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:34.731102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.730979 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:34.731102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.730999 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:11:34.731222 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.731112 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:34.731296 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.731276 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:34.731731 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.731697 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-kube-api-access-j6qbp" (OuterVolumeSpecName: "kube-api-access-j6qbp") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "kube-api-access-j6qbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:11:34.732874 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.732852 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-config-out" (OuterVolumeSpecName: "config-out") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:34.733163 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.733137 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:34.734879 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.734856 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:34.741416 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.741393 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-web-config" (OuterVolumeSpecName: "web-config") pod "f247647f-d154-4c41-9e7f-13cd686ec241" (UID: "f247647f-d154-4c41-9e7f-13cd686ec241"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829281 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829320 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-alertmanager-main-db\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829340 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829358 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6qbp\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-kube-api-access-j6qbp\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829373 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f247647f-d154-4c41-9e7f-13cd686ec241-tls-assets\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829385 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f247647f-d154-4c41-9e7f-13cd686ec241-config-out\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829408 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829426 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-config-volume\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829449 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829453 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-web-config\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829886 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829502 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f247647f-d154-4c41-9e7f-13cd686ec241-metrics-client-ca\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829886 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829513 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-cluster-tls-config\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.829886 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.829524 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f247647f-d154-4c41-9e7f-13cd686ec241-secret-alertmanager-main-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:34.973055 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.973011 2581 generic.go:356] "Generic (PLEG): container finished" podID="f247647f-d154-4c41-9e7f-13cd686ec241" containerID="32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f" exitCode=0 Jul 06 19:11:34.973229 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.973108 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:34.973229 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.973100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerDied","Data":"32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f"} Jul 06 19:11:34.973319 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.973254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f247647f-d154-4c41-9e7f-13cd686ec241","Type":"ContainerDied","Data":"ad3a61d7520217885fd475906633d5089fcf9bdba31b68bc289f80c74756339c"} Jul 06 19:11:34.973319 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.973290 2581 scope.go:117] "RemoveContainer" containerID="06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed" Jul 06 19:11:34.980905 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.980888 2581 scope.go:117] "RemoveContainer" containerID="1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287" Jul 06 19:11:34.988006 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.987988 2581 scope.go:117] "RemoveContainer" containerID="8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b" Jul 06 19:11:34.994848 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:34.994829 2581 scope.go:117] "RemoveContainer" containerID="32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f" Jul 06 19:11:35.002927 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.002909 2581 scope.go:117] "RemoveContainer" containerID="ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685" Jul 06 19:11:35.006412 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.006388 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:35.007692 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.007670 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:35.011163 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.011148 2581 scope.go:117] "RemoveContainer" containerID="43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a" Jul 06 19:11:35.018365 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.018347 2581 scope.go:117] "RemoveContainer" containerID="24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34" Jul 06 19:11:35.025097 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.025080 2581 scope.go:117] "RemoveContainer" containerID="06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed" Jul 06 19:11:35.025354 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:11:35.025336 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed\": container with ID starting with 06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed not found: ID does not exist" containerID="06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed" Jul 06 19:11:35.025402 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.025362 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed"} err="failed to get container status \"06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed\": rpc error: code = NotFound desc = could not find container \"06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed\": container with ID starting with 06565fcf411f0c983745706ac1f76cfc05956eaacae3164a7693e5ab52fad2ed not found: ID does not exist" Jul 06 19:11:35.025402 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.025382 2581 scope.go:117] "RemoveContainer" containerID="1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287" Jul 06 19:11:35.025649 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:11:35.025631 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287\": container with ID starting with 1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287 not found: ID does not exist" containerID="1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287" Jul 06 19:11:35.025690 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.025654 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287"} err="failed to get container status \"1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287\": rpc error: code = NotFound desc = could not find container \"1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287\": container with ID starting with 1447c38a9c66879ae4f3a00278767df13f45cb27affd58222a91c238120e1287 not found: ID does not exist" Jul 06 19:11:35.025690 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.025674 2581 scope.go:117] "RemoveContainer" containerID="8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b" Jul 06 19:11:35.025876 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:11:35.025861 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b\": container with ID starting with 8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b not found: ID does not exist" containerID="8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b" Jul 06 19:11:35.025923 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.025879 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b"} err="failed to get container status \"8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b\": rpc error: code = NotFound desc = could not find container \"8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b\": container with ID starting with 8784535e308d6e949020c21ce32a2396956a6ad6ffb3faf3fff9330f8021573b not found: ID does not exist" Jul 06 19:11:35.025923 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.025893 2581 scope.go:117] "RemoveContainer" containerID="32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f" Jul 06 19:11:35.026089 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:11:35.026072 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f\": container with ID starting with 32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f not found: ID does not exist" containerID="32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f" Jul 06 19:11:35.026127 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.026093 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f"} err="failed to get container status \"32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f\": rpc error: code = NotFound desc = could not find container \"32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f\": container with ID starting with 32004ab23d0a79a33c5c6ca08ed847c97286f0cafba12b770d9f3af653f40a7f not found: ID does not exist" Jul 06 19:11:35.026127 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.026105 2581 scope.go:117] "RemoveContainer" containerID="ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685" Jul 06 19:11:35.026337 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:11:35.026320 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685\": container with ID starting with ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685 not found: ID does not exist" containerID="ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685" Jul 06 19:11:35.026382 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.026346 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685"} err="failed to get container status \"ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685\": rpc error: code = NotFound desc = could not find container \"ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685\": container with ID starting with ed1013a3048e2c1ece6ecf461c4d51383c07314741ca95b3515876d6f25ad685 not found: ID does not exist" Jul 06 19:11:35.026382 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.026361 2581 scope.go:117] "RemoveContainer" containerID="43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a" Jul 06 19:11:35.026635 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:11:35.026614 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a\": container with ID starting with 43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a not found: ID does not exist" containerID="43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a" Jul 06 19:11:35.026747 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.026640 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a"} err="failed to get container status \"43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a\": rpc error: code = NotFound desc = could not find container \"43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a\": container with ID starting with 43cd237773464c44a4c7788a7fc29584e9c46bcf5e2b2e06a9bafc98744f596a not found: ID does not exist" Jul 06 19:11:35.026747 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.026653 2581 scope.go:117] "RemoveContainer" containerID="24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34" Jul 06 19:11:35.026890 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:11:35.026873 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34\": container with ID starting with 24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34 not found: ID does not exist" containerID="24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34" Jul 06 19:11:35.026933 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.026893 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34"} err="failed to get container status \"24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34\": rpc error: code = NotFound desc = could not find container \"24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34\": container with ID starting with 24068ce3ab252b62da370674b6779452460e91910850b40319ef3793b05caa34 not found: ID does not exist" Jul 06 19:11:35.052862 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.052833 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:35.053145 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053133 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4737cd7a-6e47-4b01-b952-266b99c5da84" containerName="registry" Jul 06 19:11:35.053191 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053146 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4737cd7a-6e47-4b01-b952-266b99c5da84" containerName="registry" Jul 06 19:11:35.053191 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053154 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="config-reloader" Jul 06 19:11:35.053191 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053159 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="config-reloader" Jul 06 19:11:35.053191 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053170 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="alertmanager" Jul 06 19:11:35.053191 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053175 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="alertmanager" Jul 06 19:11:35.053191 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053182 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="prom-label-proxy" Jul 06 19:11:35.053191 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053188 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="prom-label-proxy" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053203 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy-web" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053209 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy-web" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053217 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="init-config-reloader" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053223 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="init-config-reloader" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053230 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053235 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053240 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy-metric" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053245 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy-metric" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053293 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy-metric" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053301 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="config-reloader" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053307 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053312 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4737cd7a-6e47-4b01-b952-266b99c5da84" containerName="registry" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053318 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="alertmanager" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053324 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="prom-label-proxy" Jul 06 19:11:35.053392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.053329 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" containerName="kube-rbac-proxy-web" Jul 06 19:11:35.057158 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.057141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.061209 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.061172 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:11:35.061209 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.061195 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:11:35.061398 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.061286 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:11:35.061398 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.061314 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:11:35.061398 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.061341 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:11:35.061712 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.061698 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:11:35.061797 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.061783 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:11:35.061976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.061962 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gsbb4\"" Jul 06 19:11:35.062131 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.062115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:11:35.069592 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.069574 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:11:35.094070 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.094042 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:35.232660 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc97140-3291-4bd7-b2ad-893af0b111a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.232660 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.232660 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.232904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7mq5\" (UniqueName: \"kubernetes.io/projected/1fc97140-3291-4bd7-b2ad-893af0b111a8-kube-api-access-p7mq5\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.232904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1fc97140-3291-4bd7-b2ad-893af0b111a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.232904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.232904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fc97140-3291-4bd7-b2ad-893af0b111a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.232904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-web-config\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.232904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.233161 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fc97140-3291-4bd7-b2ad-893af0b111a8-config-out\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.233161 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fc97140-3291-4bd7-b2ad-893af0b111a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.233161 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.233161 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.232983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.334170 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334141 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-web-config\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.334297 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.334297 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334226 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fc97140-3291-4bd7-b2ad-893af0b111a8-config-out\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.334297 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fc97140-3291-4bd7-b2ad-893af0b111a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.334297 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.334297 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.335222 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc97140-3291-4bd7-b2ad-893af0b111a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.335222 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.335222 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.335222 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7mq5\" (UniqueName: \"kubernetes.io/projected/1fc97140-3291-4bd7-b2ad-893af0b111a8-kube-api-access-p7mq5\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.335222 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1fc97140-3291-4bd7-b2ad-893af0b111a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.335222 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.335222 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.334861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fc97140-3291-4bd7-b2ad-893af0b111a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.335666 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.335603 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fc97140-3291-4bd7-b2ad-893af0b111a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.336996 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.336405 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc97140-3291-4bd7-b2ad-893af0b111a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.336996 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.336670 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1fc97140-3291-4bd7-b2ad-893af0b111a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.337650 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.337263 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fc97140-3291-4bd7-b2ad-893af0b111a8-config-out\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.337650 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.337436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-web-config\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.337823 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.337765 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.337890 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.337877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fc97140-3291-4bd7-b2ad-893af0b111a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.337997 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.337976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.338302 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.338282 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.338829 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.338811 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.339196 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.339176 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.339526 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.339507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fc97140-3291-4bd7-b2ad-893af0b111a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.347193 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.347175 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7mq5\" (UniqueName: \"kubernetes.io/projected/1fc97140-3291-4bd7-b2ad-893af0b111a8-kube-api-access-p7mq5\") pod \"alertmanager-main-0\" (UID: \"1fc97140-3291-4bd7-b2ad-893af0b111a8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.367229 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.367201 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:35.521831 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.521750 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:35.526184 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:11:35.526154 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc97140_3291_4bd7_b2ad_893af0b111a8.slice/crio-e2d46e302757e61fd390e23179c7014d9376067764cbe67fa729663279cb2b57 WatchSource:0}: Error finding container e2d46e302757e61fd390e23179c7014d9376067764cbe67fa729663279cb2b57: Status 404 returned error can't find the container with id e2d46e302757e61fd390e23179c7014d9376067764cbe67fa729663279cb2b57 Jul 06 19:11:35.978890 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.978854 2581 generic.go:356] "Generic (PLEG): container finished" podID="1fc97140-3291-4bd7-b2ad-893af0b111a8" containerID="71bf793dec7a79080e090bb7b78b6270a98c2f1fbee18a30f68ffc627f421ed2" exitCode=0 Jul 06 19:11:35.979309 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.978934 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1fc97140-3291-4bd7-b2ad-893af0b111a8","Type":"ContainerDied","Data":"71bf793dec7a79080e090bb7b78b6270a98c2f1fbee18a30f68ffc627f421ed2"} Jul 06 19:11:35.979309 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:35.979011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1fc97140-3291-4bd7-b2ad-893af0b111a8","Type":"ContainerStarted","Data":"e2d46e302757e61fd390e23179c7014d9376067764cbe67fa729663279cb2b57"} Jul 06 19:11:36.715801 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:36.715771 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f247647f-d154-4c41-9e7f-13cd686ec241" path="/var/lib/kubelet/pods/f247647f-d154-4c41-9e7f-13cd686ec241/volumes" Jul 06 19:11:36.987286 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:36.987195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1fc97140-3291-4bd7-b2ad-893af0b111a8","Type":"ContainerStarted","Data":"c02662e9276cf30f81096b2b75d24ae0ba377cc9a32c21dbb33b0a52f9a120a6"} Jul 06 19:11:36.987286 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:36.987267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1fc97140-3291-4bd7-b2ad-893af0b111a8","Type":"ContainerStarted","Data":"82a94a664f0f5dab85860f7c69af103727d9863db5c9fc7110c3479385e02477"} Jul 06 19:11:36.987688 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:36.987295 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1fc97140-3291-4bd7-b2ad-893af0b111a8","Type":"ContainerStarted","Data":"ae26aa18e508215ddfcc0eed858c865125de21cd054277ad579c6dbc8c89eca0"} Jul 06 19:11:36.987688 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:36.987320 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1fc97140-3291-4bd7-b2ad-893af0b111a8","Type":"ContainerStarted","Data":"c21379411b788bd66076d84c3e7dbf34786acf1d9b7feccbb24cfa734e30b0cb"} Jul 06 19:11:36.987688 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:36.987343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1fc97140-3291-4bd7-b2ad-893af0b111a8","Type":"ContainerStarted","Data":"7385f466938ab6bdceb1ae814351de147f31093422f65ebf2a117e3e659291a2"} Jul 06 19:11:36.987688 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:36.987365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1fc97140-3291-4bd7-b2ad-893af0b111a8","Type":"ContainerStarted","Data":"761ea344a1baf7f43e72f3a0c2327a1f78a4c828511b7a6402d157d22c7af206"} Jul 06 19:11:37.035980 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.035913 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.021811604 podStartE2EDuration="2.035892959s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.081355ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:37.03489903 +0000 UTC m=+373.124223187" watchObservedRunningTime="2026-07-06 19:11:37.035892959 +0000 UTC m=+373.125217116" Jul 06 19:11:37.452525 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.452428 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84bdf58886-wv4f8"] Jul 06 19:11:37.455687 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.455668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.462709 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.462684 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 19:11:37.462829 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.462723 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 19:11:37.463441 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.463422 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 19:11:37.463556 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.463539 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 19:11:37.463603 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.463547 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v9d8n\"" Jul 06 19:11:37.463636 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.463612 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 19:11:37.469505 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.469488 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 19:11:37.480970 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.480950 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84bdf58886-wv4f8"] Jul 06 19:11:37.556110 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.556080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-telemeter-client-tls\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.556301 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.556119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c5fx\" (UniqueName: \"kubernetes.io/projected/645910f4-537f-44c8-9d92-5c9042657ffa-kube-api-access-8c5fx\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.556301 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.556139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-metrics-client-ca\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.556301 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.556251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.556486 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.556340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-serving-certs-ca-bundle\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.556486 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.556388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-secret-telemeter-client\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.556486 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.556421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-federate-client-tls\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.556486 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.556441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.657761 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.657724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-serving-certs-ca-bundle\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.657773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-secret-telemeter-client\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.657805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-federate-client-tls\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.657823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.657847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-telemeter-client-tls\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.657871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5fx\" (UniqueName: \"kubernetes.io/projected/645910f4-537f-44c8-9d92-5c9042657ffa-kube-api-access-8c5fx\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.657926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-metrics-client-ca\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.657982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658617 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.658584 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-serving-certs-ca-bundle\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.658710 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.658638 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-metrics-client-ca\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.659027 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.659000 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/645910f4-537f-44c8-9d92-5c9042657ffa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.660455 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.660427 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.660566 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.660483 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-federate-client-tls\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.660753 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.660733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-telemeter-client-tls\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.660848 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.660827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/645910f4-537f-44c8-9d92-5c9042657ffa-secret-telemeter-client\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.669845 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.669819 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c5fx\" (UniqueName: \"kubernetes.io/projected/645910f4-537f-44c8-9d92-5c9042657ffa-kube-api-access-8c5fx\") pod \"telemeter-client-84bdf58886-wv4f8\" (UID: \"645910f4-537f-44c8-9d92-5c9042657ffa\") " pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.765077 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.765048 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" Jul 06 19:11:37.767208 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.767182 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:11:37.767530 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.767488 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="prometheus" containerID="cri-o://8e5b32e61bec73109369c151959150a299cba7239eed867778feebcf31fca789" gracePeriod=600 Jul 06 19:11:37.767627 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.767524 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c9762437d620232a973d12440fce77759f5f2cf3ab912ab1d422afb2db2364d2" gracePeriod=600 Jul 06 19:11:37.767627 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.767555 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="thanos-sidecar" containerID="cri-o://e09a256409a379b06ff1b354f94435df8ac54e53a0ad60cb6bbe449539c9c910" gracePeriod=600 Jul 06 19:11:37.767627 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.767561 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy-web" containerID="cri-o://0901fa9d100f76834b86f431997169267dc625b6168dd1fe498c2a67e0ce6e2a" gracePeriod=600 Jul 06 19:11:37.767788 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.767642 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="config-reloader" containerID="cri-o://9621a9ae944637f4a31aa68efbc55df71384df7c0163265809debe9fc9a0e5e7" gracePeriod=600 Jul 06 19:11:37.767788 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.767682 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy" containerID="cri-o://72fe7ce43e17722aae7df97667a4938afc3172dd8060cec98a73bdfca51041a3" gracePeriod=600 Jul 06 19:11:37.931307 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.931271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84bdf58886-wv4f8"] Jul 06 19:11:37.934523 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:11:37.934496 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645910f4_537f_44c8_9d92_5c9042657ffa.slice/crio-61ed011d9c49de11c83d41edf9745a4264ce6ca4af4a0b15008d7f4343a8b63d WatchSource:0}: Error finding container 61ed011d9c49de11c83d41edf9745a4264ce6ca4af4a0b15008d7f4343a8b63d: Status 404 returned error can't find the container with id 61ed011d9c49de11c83d41edf9745a4264ce6ca4af4a0b15008d7f4343a8b63d Jul 06 19:11:37.936328 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.936310 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:11:37.995430 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995401 2581 generic.go:356] "Generic (PLEG): container finished" podID="4631316b-2466-4b65-b46e-a1711e650810" containerID="c9762437d620232a973d12440fce77759f5f2cf3ab912ab1d422afb2db2364d2" exitCode=0 Jul 06 19:11:37.995430 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995426 2581 generic.go:356] "Generic (PLEG): container finished" podID="4631316b-2466-4b65-b46e-a1711e650810" containerID="72fe7ce43e17722aae7df97667a4938afc3172dd8060cec98a73bdfca51041a3" exitCode=0 Jul 06 19:11:37.995430 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995433 2581 generic.go:356] "Generic (PLEG): container finished" podID="4631316b-2466-4b65-b46e-a1711e650810" containerID="0901fa9d100f76834b86f431997169267dc625b6168dd1fe498c2a67e0ce6e2a" exitCode=0 Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995441 2581 generic.go:356] "Generic (PLEG): container finished" podID="4631316b-2466-4b65-b46e-a1711e650810" containerID="e09a256409a379b06ff1b354f94435df8ac54e53a0ad60cb6bbe449539c9c910" exitCode=0 Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995446 2581 generic.go:356] "Generic (PLEG): container finished" podID="4631316b-2466-4b65-b46e-a1711e650810" containerID="9621a9ae944637f4a31aa68efbc55df71384df7c0163265809debe9fc9a0e5e7" exitCode=0 Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995451 2581 generic.go:356] "Generic (PLEG): container finished" podID="4631316b-2466-4b65-b46e-a1711e650810" containerID="8e5b32e61bec73109369c151959150a299cba7239eed867778feebcf31fca789" exitCode=0 Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerDied","Data":"c9762437d620232a973d12440fce77759f5f2cf3ab912ab1d422afb2db2364d2"} Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995552 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerDied","Data":"72fe7ce43e17722aae7df97667a4938afc3172dd8060cec98a73bdfca51041a3"} Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995590 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerDied","Data":"0901fa9d100f76834b86f431997169267dc625b6168dd1fe498c2a67e0ce6e2a"} Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995614 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerDied","Data":"e09a256409a379b06ff1b354f94435df8ac54e53a0ad60cb6bbe449539c9c910"} Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995653 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerDied","Data":"9621a9ae944637f4a31aa68efbc55df71384df7c0163265809debe9fc9a0e5e7"} Jul 06 19:11:37.995976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.995681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerDied","Data":"8e5b32e61bec73109369c151959150a299cba7239eed867778feebcf31fca789"} Jul 06 19:11:37.996782 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:37.996760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" event={"ID":"645910f4-537f-44c8-9d92-5c9042657ffa","Type":"ContainerStarted","Data":"61ed011d9c49de11c83d41edf9745a4264ce6ca4af4a0b15008d7f4343a8b63d"} Jul 06 19:11:38.009643 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.009624 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:38.162133 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162051 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-metrics-client-certs\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162133 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162087 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-tls\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162133 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162106 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-web-config\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162133 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162133 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-db\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162149 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x42lf\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-kube-api-access-x42lf\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162175 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-grpc-tls\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162225 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-trusted-ca-bundle\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162278 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-tls-assets\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162317 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-config-out\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162345 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-metrics-client-ca\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162385 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-thanos-prometheus-http-client-file\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162411 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-config\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162509 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162454 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162945 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162555 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-kube-rbac-proxy\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162945 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162588 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-2\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162945 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162615 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-0\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.162945 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.162640 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-kubelet-serving-ca-bundle\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.163140 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.163000 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:38.163140 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.163085 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:38.163256 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.163140 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.163256 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.163188 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-1\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.163256 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.163216 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-serving-certs-ca-bundle\") pod \"4631316b-2466-4b65-b46e-a1711e650810\" (UID: \"4631316b-2466-4b65-b46e-a1711e650810\") " Jul 06 19:11:38.163835 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.163817 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.163997 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.163842 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.166446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.164596 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:38.166446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.164861 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-kube-api-access-x42lf" (OuterVolumeSpecName: "kube-api-access-x42lf") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "kube-api-access-x42lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:11:38.166446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.164927 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:38.166446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.165295 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:38.166446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.165618 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:38.166446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.165884 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:38.168454 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.166424 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.168571 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.168508 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.168636 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.168597 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.168691 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.168654 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.168815 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.168746 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.168918 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.168900 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:11:38.168996 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.168981 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.169051 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.169011 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:11:38.170660 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.170635 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-config-out" (OuterVolumeSpecName: "config-out") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:11:38.173599 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.171040 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-config" (OuterVolumeSpecName: "config") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.173599 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.171590 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.185224 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.185194 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-web-config" (OuterVolumeSpecName: "web-config") pod "4631316b-2466-4b65-b46e-a1711e650810" (UID: "4631316b-2466-4b65-b46e-a1711e650810"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:11:38.264561 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264520 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264561 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264552 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-web-config\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264561 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264561 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-db\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264561 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264570 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x42lf\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-kube-api-access-x42lf\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264579 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-grpc-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264588 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4631316b-2466-4b65-b46e-a1711e650810-tls-assets\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264595 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4631316b-2466-4b65-b46e-a1711e650810-config-out\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264603 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-metrics-client-ca\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264612 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264621 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-config\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264632 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264642 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-kube-rbac-proxy\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264650 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264658 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264666 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264674 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264682 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4631316b-2466-4b65-b46e-a1711e650810-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.264826 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.264691 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4631316b-2466-4b65-b46e-a1711e650810-secret-metrics-client-certs\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:11:38.466420 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.466392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:11:38.468643 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.468625 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b13928a4-8ea4-4208-b577-30710d00a7bd-metrics-certs\") pod \"network-metrics-daemon-vbkcv\" (UID: \"b13928a4-8ea4-4208-b577-30710d00a7bd\") " pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:11:38.529445 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.529416 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb5ss\"" Jul 06 19:11:38.531495 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:38.531479 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbkcv" Jul 06 19:11:39.005035 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.004948 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4631316b-2466-4b65-b46e-a1711e650810","Type":"ContainerDied","Data":"76c0d0951c9f3806cfb657b111f95853aa0147b20c7d894b42b150a453c8dcfc"} Jul 06 19:11:39.005035 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.004977 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.005035 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.005023 2581 scope.go:117] "RemoveContainer" containerID="c9762437d620232a973d12440fce77759f5f2cf3ab912ab1d422afb2db2364d2" Jul 06 19:11:39.012870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.012849 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vbkcv"] Jul 06 19:11:39.013981 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.013934 2581 scope.go:117] "RemoveContainer" containerID="72fe7ce43e17722aae7df97667a4938afc3172dd8060cec98a73bdfca51041a3" Jul 06 19:11:39.015051 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:11:39.014991 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13928a4_8ea4_4208_b577_30710d00a7bd.slice/crio-ec1d6bec25b9ae5112ed45aba6a918bdf030a8c70c78b3db66fbaffe51db387c WatchSource:0}: Error finding container ec1d6bec25b9ae5112ed45aba6a918bdf030a8c70c78b3db66fbaffe51db387c: Status 404 returned error can't find the container with id ec1d6bec25b9ae5112ed45aba6a918bdf030a8c70c78b3db66fbaffe51db387c Jul 06 19:11:39.025219 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.025202 2581 scope.go:117] "RemoveContainer" containerID="0901fa9d100f76834b86f431997169267dc625b6168dd1fe498c2a67e0ce6e2a" Jul 06 19:11:39.032174 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.032151 2581 scope.go:117] "RemoveContainer" containerID="e09a256409a379b06ff1b354f94435df8ac54e53a0ad60cb6bbe449539c9c910" Jul 06 19:11:39.039078 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.039060 2581 scope.go:117] "RemoveContainer" containerID="9621a9ae944637f4a31aa68efbc55df71384df7c0163265809debe9fc9a0e5e7" Jul 06 19:11:39.046439 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.046421 2581 scope.go:117] "RemoveContainer" containerID="8e5b32e61bec73109369c151959150a299cba7239eed867778feebcf31fca789" Jul 06 19:11:39.053582 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.053563 2581 scope.go:117] "RemoveContainer" containerID="794fcbc8b17badd661011c201022bee42e476364ce69fb1a51c2b7ab9d1ae753" Jul 06 19:11:39.060273 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.060250 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:11:39.082215 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.082190 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:11:39.157784 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.157751 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:11:39.158096 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158083 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="thanos-sidecar" Jul 06 19:11:39.158150 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158098 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="thanos-sidecar" Jul 06 19:11:39.158150 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158108 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy-thanos" Jul 06 19:11:39.158150 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158114 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy-thanos" Jul 06 19:11:39.158150 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158126 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="prometheus" Jul 06 19:11:39.158150 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158134 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="prometheus" Jul 06 19:11:39.158150 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158143 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="config-reloader" Jul 06 19:11:39.158150 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158149 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="config-reloader" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158156 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy-web" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158162 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy-web" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158170 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="init-config-reloader" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158177 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="init-config-reloader" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158193 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158198 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158255 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy-web" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158264 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="thanos-sidecar" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158273 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="config-reloader" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158280 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="prometheus" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158287 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy-thanos" Jul 06 19:11:39.158384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.158296 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4631316b-2466-4b65-b46e-a1711e650810" containerName="kube-rbac-proxy" Jul 06 19:11:39.162157 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.162139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.167064 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.167043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:11:39.167210 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.167141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c8egq529croji\"" Jul 06 19:11:39.167323 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.167311 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:11:39.167519 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.167505 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:11:39.167897 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.167883 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:11:39.167960 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.167913 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rl8b2\"" Jul 06 19:11:39.167960 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.167945 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:11:39.174149 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.174122 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:11:39.183539 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.183508 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:11:39.183539 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.183509 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:11:39.183715 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.183662 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:11:39.183715 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.183670 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:11:39.183817 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.183718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:11:39.183882 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.183843 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:11:39.184092 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.184076 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:11:39.186104 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.186057 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:11:39.204804 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.204781 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:11:39.272517 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272517 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272694 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272694 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272694 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272694 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272694 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272694 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272731 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a74d9551-ac48-4001-850d-875a7f90ebe1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272849 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a74d9551-ac48-4001-850d-875a7f90ebe1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.272870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.273075 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.273075 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.273075 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-config\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.273075 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2fj\" (UniqueName: \"kubernetes.io/projected/a74d9551-ac48-4001-850d-875a7f90ebe1-kube-api-access-cn2fj\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.273075 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.272978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373565 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373565 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a74d9551-ac48-4001-850d-875a7f90ebe1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a74d9551-ac48-4001-850d-875a7f90ebe1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.373818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-config\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2fj\" (UniqueName: \"kubernetes.io/projected/a74d9551-ac48-4001-850d-875a7f90ebe1-kube-api-access-cn2fj\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.373959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.374012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.374044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.374072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.374099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.374124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374795 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.374285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374795 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.374368 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.374795 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.374591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.375847 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.375165 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.375847 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.375380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.375847 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.375720 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.375847 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.375802 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.378078 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.378016 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a74d9551-ac48-4001-850d-875a7f90ebe1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.378196 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.378118 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a74d9551-ac48-4001-850d-875a7f90ebe1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.378275 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.378225 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.378546 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.378526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.378929 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.378861 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a74d9551-ac48-4001-850d-875a7f90ebe1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.379231 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.379209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.379323 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.379257 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-config\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.379382 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.379350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.379671 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.379654 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.379750 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.379718 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.380386 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.380367 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.380990 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.380971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a74d9551-ac48-4001-850d-875a7f90ebe1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.386394 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.386377 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2fj\" (UniqueName: \"kubernetes.io/projected/a74d9551-ac48-4001-850d-875a7f90ebe1-kube-api-access-cn2fj\") pod \"prometheus-k8s-0\" (UID: \"a74d9551-ac48-4001-850d-875a7f90ebe1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.472601 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.472557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:39.668628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:39.668584 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:11:39.673965 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:11:39.673934 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74d9551_ac48_4001_850d_875a7f90ebe1.slice/crio-5d590f2059b989716a4bce95779549ae9444a249521a17857d599abb28b78428 WatchSource:0}: Error finding container 5d590f2059b989716a4bce95779549ae9444a249521a17857d599abb28b78428: Status 404 returned error can't find the container with id 5d590f2059b989716a4bce95779549ae9444a249521a17857d599abb28b78428 Jul 06 19:11:40.011671 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:40.011632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbkcv" event={"ID":"b13928a4-8ea4-4208-b577-30710d00a7bd","Type":"ContainerStarted","Data":"ec1d6bec25b9ae5112ed45aba6a918bdf030a8c70c78b3db66fbaffe51db387c"} Jul 06 19:11:40.014532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:40.014505 2581 generic.go:356] "Generic (PLEG): container finished" podID="a74d9551-ac48-4001-850d-875a7f90ebe1" containerID="a4b8a86a34dc427e97ad67508e5d389182d3557a9041f0bcc7ed64e071668598" exitCode=0 Jul 06 19:11:40.014669 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:40.014543 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a74d9551-ac48-4001-850d-875a7f90ebe1","Type":"ContainerDied","Data":"a4b8a86a34dc427e97ad67508e5d389182d3557a9041f0bcc7ed64e071668598"} Jul 06 19:11:40.014669 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:40.014601 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a74d9551-ac48-4001-850d-875a7f90ebe1","Type":"ContainerStarted","Data":"5d590f2059b989716a4bce95779549ae9444a249521a17857d599abb28b78428"} Jul 06 19:11:40.716622 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:40.716578 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4631316b-2466-4b65-b46e-a1711e650810" path="/var/lib/kubelet/pods/4631316b-2466-4b65-b46e-a1711e650810/volumes" Jul 06 19:11:41.022318 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.022284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a74d9551-ac48-4001-850d-875a7f90ebe1","Type":"ContainerStarted","Data":"a6085eafdcb1db3d619742e8af7d4dc323ee7b30d5d73829852a7d771b067beb"} Jul 06 19:11:41.022693 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.022368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a74d9551-ac48-4001-850d-875a7f90ebe1","Type":"ContainerStarted","Data":"18e5511cd1d34aac00e07c0a0c30c88288d1433f4768fde84ae4c603268cf16d"} Jul 06 19:11:41.022693 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.022408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a74d9551-ac48-4001-850d-875a7f90ebe1","Type":"ContainerStarted","Data":"1aaeafb08a1cd851eaf1f56ac61c86c68e093a9669c6de09885f7cd8305506b3"} Jul 06 19:11:41.022693 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.022452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a74d9551-ac48-4001-850d-875a7f90ebe1","Type":"ContainerStarted","Data":"93ba730f242b3d52b042169b2df0b8ff868ac62ea5467a54fd29205eccba9a9f"} Jul 06 19:11:41.022693 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.022524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a74d9551-ac48-4001-850d-875a7f90ebe1","Type":"ContainerStarted","Data":"73e51c7cfa63597008f4cfb269a26da825a053aa2edde94bc9a543ba41767382"} Jul 06 19:11:41.022693 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.022563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a74d9551-ac48-4001-850d-875a7f90ebe1","Type":"ContainerStarted","Data":"1c9e9b10bb30851ac2c06c6d3bbfadd7d42a525c9c9ffdd2a1baf38c22041cd6"} Jul 06 19:11:41.024684 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.024657 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" event={"ID":"645910f4-537f-44c8-9d92-5c9042657ffa","Type":"ContainerStarted","Data":"c7002f514c0a7e2d811f30caeb78bcfa72f9c80088b39f601d08ffbe05b221ea"} Jul 06 19:11:41.024781 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.024717 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" event={"ID":"645910f4-537f-44c8-9d92-5c9042657ffa","Type":"ContainerStarted","Data":"3daf771102b839d68ecb475d407f73aa17b5d12651580f8b2952e5de8b8516af"} Jul 06 19:11:41.024781 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.024747 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" event={"ID":"645910f4-537f-44c8-9d92-5c9042657ffa","Type":"ContainerStarted","Data":"da87901c67a1494971c05b56eb216084a56c736b70171523c4b204345b583b2a"} Jul 06 19:11:41.026417 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.026392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbkcv" event={"ID":"b13928a4-8ea4-4208-b577-30710d00a7bd","Type":"ContainerStarted","Data":"d3d217ceb77a19391e7be4e1e6f6e397f690a385ec559b582b1437e718cc626c"} Jul 06 19:11:41.026518 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.026428 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbkcv" event={"ID":"b13928a4-8ea4-4208-b577-30710d00a7bd","Type":"ContainerStarted","Data":"066271dd3abf591ae213ad0cad2692ddee4cf14fd4486be7d2ea1ae70863bb83"} Jul 06 19:11:41.064289 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.064238 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.033022458 podStartE2EDuration="2.06422197s" totalImagesPullingTime="0s" totalInitContainerRuntime="31.199512ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:11:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:41.061786735 +0000 UTC m=+377.151110919" watchObservedRunningTime="2026-07-06 19:11:41.06422197 +0000 UTC m=+377.153546127" Jul 06 19:11:41.083627 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.083576 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vbkcv" podStartSLOduration=375.003340149 podStartE2EDuration="6m16.083557176s" totalImagesPullingTime="1.080217027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:41.083172984 +0000 UTC m=+377.172497140" watchObservedRunningTime="2026-07-06 19:11:41.083557176 +0000 UTC m=+377.172881332" Jul 06 19:11:41.111403 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.111353 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84bdf58886-wv4f8" podStartSLOduration=1.256153786 podStartE2EDuration="4.111339242s" totalImagesPullingTime="2.855185456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:41.110670761 +0000 UTC m=+377.199994934" watchObservedRunningTime="2026-07-06 19:11:41.111339242 +0000 UTC m=+377.200663398" Jul 06 19:11:41.123193 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.123164 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:41.226601 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.226555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:41.321712 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.321630 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:41.476299 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.476257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:41.544212 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.544176 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:41.897167 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:41.897139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:42.001859 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:42.001793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:42.095122 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:42.095090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:42.578236 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:42.578201 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:42.680029 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:42.679990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:44.473543 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:44.473512 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:52.552695 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:52.552659 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:11:52.660284 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:11:52.660248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:23.464973 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:23.464923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:23.564840 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:23.564809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:39.472985 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:39.472943 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:12:39.489448 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:39.489427 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:12:40.288365 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:40.288339 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:12:47.613277 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:47.613190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:47.727734 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:47.727702 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:59.553511 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:59.553458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:12:59.630125 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:12:59.630092 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:05.119933 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:05.119897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:05.224817 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:05.224777 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:05.538034 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:05.537999 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:15.030254 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:15.030223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:15.138065 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:15.138031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:25.814133 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:25.814099 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:25.918404 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:25.918367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:25.985203 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:25.985171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:33.244745 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:33.244705 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:33.341302 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:33.341268 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:54.993975 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:54.993936 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:55.939248 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:55.939217 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:58.745187 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:58.745155 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:13:58.840649 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:13:58.840620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:00.821077 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:00.821041 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:00.928432 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:00.928385 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:01.152911 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:01.152828 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:01.257856 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:01.257821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:02.636251 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:02.636215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:03.237861 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:03.237821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:03.497238 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:03.497154 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:05.735596 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:05.735563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:05.800973 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:05.800935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:07.910540 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:07.910503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:07.999674 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:07.999641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:10.464592 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:10.464559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:11.184609 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.184577 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7fcss"] Jul 06 19:14:11.187147 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.187126 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7fcss" Jul 06 19:14:11.194193 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.194175 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 19:14:11.194994 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.194979 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 19:14:11.195065 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.194992 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sj2bm\"" Jul 06 19:14:11.208225 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.208203 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7fcss"] Jul 06 19:14:11.274919 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.274891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6332cd9-c87d-42dc-b0eb-7ad4083898b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-7fcss\" (UID: \"b6332cd9-c87d-42dc-b0eb-7ad4083898b8\") " pod="cert-manager/cert-manager-55b4d954d5-7fcss" Jul 06 19:14:11.275065 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.274930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z99pn\" (UniqueName: \"kubernetes.io/projected/b6332cd9-c87d-42dc-b0eb-7ad4083898b8-kube-api-access-z99pn\") pod \"cert-manager-55b4d954d5-7fcss\" (UID: \"b6332cd9-c87d-42dc-b0eb-7ad4083898b8\") " pod="cert-manager/cert-manager-55b4d954d5-7fcss" Jul 06 19:14:11.376205 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.376170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6332cd9-c87d-42dc-b0eb-7ad4083898b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-7fcss\" (UID: \"b6332cd9-c87d-42dc-b0eb-7ad4083898b8\") " pod="cert-manager/cert-manager-55b4d954d5-7fcss" Jul 06 19:14:11.376367 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.376217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z99pn\" (UniqueName: \"kubernetes.io/projected/b6332cd9-c87d-42dc-b0eb-7ad4083898b8-kube-api-access-z99pn\") pod \"cert-manager-55b4d954d5-7fcss\" (UID: \"b6332cd9-c87d-42dc-b0eb-7ad4083898b8\") " pod="cert-manager/cert-manager-55b4d954d5-7fcss" Jul 06 19:14:11.389772 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.389740 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z99pn\" (UniqueName: \"kubernetes.io/projected/b6332cd9-c87d-42dc-b0eb-7ad4083898b8-kube-api-access-z99pn\") pod \"cert-manager-55b4d954d5-7fcss\" (UID: \"b6332cd9-c87d-42dc-b0eb-7ad4083898b8\") " pod="cert-manager/cert-manager-55b4d954d5-7fcss" Jul 06 19:14:11.389772 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.389753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6332cd9-c87d-42dc-b0eb-7ad4083898b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-7fcss\" (UID: \"b6332cd9-c87d-42dc-b0eb-7ad4083898b8\") " pod="cert-manager/cert-manager-55b4d954d5-7fcss" Jul 06 19:14:11.513074 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.513043 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7fcss" Jul 06 19:14:11.646761 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:11.646733 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7fcss"] Jul 06 19:14:11.656286 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:14:11.656243 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6332cd9_c87d_42dc_b0eb_7ad4083898b8.slice/crio-653397eacb809d8dbcfb4af1529f48554006cddf8df6c93486007da9173056ad WatchSource:0}: Error finding container 653397eacb809d8dbcfb4af1529f48554006cddf8df6c93486007da9173056ad: Status 404 returned error can't find the container with id 653397eacb809d8dbcfb4af1529f48554006cddf8df6c93486007da9173056ad Jul 06 19:14:12.057790 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:12.057749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:12.346775 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:12.346675 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:12.453274 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:12.453213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:12.660837 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:12.660746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7fcss" event={"ID":"b6332cd9-c87d-42dc-b0eb-7ad4083898b8","Type":"ContainerStarted","Data":"653397eacb809d8dbcfb4af1529f48554006cddf8df6c93486007da9173056ad"} Jul 06 19:14:14.671785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:14.671703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7fcss" event={"ID":"b6332cd9-c87d-42dc-b0eb-7ad4083898b8","Type":"ContainerStarted","Data":"3706e21fa2f41249c80dbc1a51f234c10dc2194b7e90ee126d009dbcc6b159d1"} Jul 06 19:14:14.698689 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:14.698642 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7fcss" podStartSLOduration=0.953648756 podStartE2EDuration="3.698626334s" totalImagesPullingTime="2.744977578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:14.698449007 +0000 UTC m=+530.787773192" watchObservedRunningTime="2026-07-06 19:14:14.698626334 +0000 UTC m=+530.787950491" Jul 06 19:14:15.499057 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.499027 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99"] Jul 06 19:14:15.501203 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.501188 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" Jul 06 19:14:15.503778 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.503753 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tlt2f\"" Jul 06 19:14:15.504025 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.504005 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:14:15.504185 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.504173 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:14:15.513397 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.513378 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99"] Jul 06 19:14:15.616982 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.616950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6bac3c7-d0e5-4477-bad9-990777181f4b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lgm99\" (UID: \"f6bac3c7-d0e5-4477-bad9-990777181f4b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" Jul 06 19:14:15.617140 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.617055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxgfn\" (UniqueName: \"kubernetes.io/projected/f6bac3c7-d0e5-4477-bad9-990777181f4b-kube-api-access-xxgfn\") pod \"openshift-lws-operator-fd8ccff4c-lgm99\" (UID: \"f6bac3c7-d0e5-4477-bad9-990777181f4b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" Jul 06 19:14:15.717937 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.717904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6bac3c7-d0e5-4477-bad9-990777181f4b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lgm99\" (UID: \"f6bac3c7-d0e5-4477-bad9-990777181f4b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" Jul 06 19:14:15.718398 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.718008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxgfn\" (UniqueName: \"kubernetes.io/projected/f6bac3c7-d0e5-4477-bad9-990777181f4b-kube-api-access-xxgfn\") pod \"openshift-lws-operator-fd8ccff4c-lgm99\" (UID: \"f6bac3c7-d0e5-4477-bad9-990777181f4b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" Jul 06 19:14:15.718398 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.718265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6bac3c7-d0e5-4477-bad9-990777181f4b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lgm99\" (UID: \"f6bac3c7-d0e5-4477-bad9-990777181f4b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" Jul 06 19:14:15.732952 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.732920 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxgfn\" (UniqueName: \"kubernetes.io/projected/f6bac3c7-d0e5-4477-bad9-990777181f4b-kube-api-access-xxgfn\") pod \"openshift-lws-operator-fd8ccff4c-lgm99\" (UID: \"f6bac3c7-d0e5-4477-bad9-990777181f4b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" Jul 06 19:14:15.809998 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.809921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" Jul 06 19:14:15.952181 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:15.952151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99"] Jul 06 19:14:15.955491 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:14:15.955443 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6bac3c7_d0e5_4477_bad9_990777181f4b.slice/crio-0f373b7d1a66ab100bfdeb12e65d991f133495e5b211f4ce48c576b6c92771fc WatchSource:0}: Error finding container 0f373b7d1a66ab100bfdeb12e65d991f133495e5b211f4ce48c576b6c92771fc: Status 404 returned error can't find the container with id 0f373b7d1a66ab100bfdeb12e65d991f133495e5b211f4ce48c576b6c92771fc Jul 06 19:14:16.684390 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:16.684335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" event={"ID":"f6bac3c7-d0e5-4477-bad9-990777181f4b","Type":"ContainerStarted","Data":"0f373b7d1a66ab100bfdeb12e65d991f133495e5b211f4ce48c576b6c92771fc"} Jul 06 19:14:18.695573 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:18.695534 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" event={"ID":"f6bac3c7-d0e5-4477-bad9-990777181f4b","Type":"ContainerStarted","Data":"b5b4ae624bf3d11772e0bde3e20a8c4affcdf63644df4b9d41a0bbc289356a58"} Jul 06 19:14:18.714958 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:18.714902 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lgm99" podStartSLOduration=1.509591097 podStartE2EDuration="3.714881573s" totalImagesPullingTime="2.205290476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:18.714540783 +0000 UTC m=+534.803864942" watchObservedRunningTime="2026-07-06 19:14:18.714881573 +0000 UTC m=+534.804205728" Jul 06 19:14:19.490431 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:19.490397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:19.588111 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:19.588082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:21.360715 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:21.360682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:25.462045 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:25.461995 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:25.563135 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:25.563103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:33.373556 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:33.373521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:35.582143 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:35.582107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:35.652572 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:35.652532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:39.455422 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:39.455387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:39.559266 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:39.559235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:40.121168 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.121134 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:40.291116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.291083 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:40.392800 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.392720 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:40.544567 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.544535 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s"] Jul 06 19:14:40.547448 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.547430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.552408 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.552385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4g7rx\"" Jul 06 19:14:40.553139 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.553004 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:14:40.553139 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.553080 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:14:40.553139 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.553136 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:14:40.553439 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.553424 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:14:40.572484 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.572426 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s"] Jul 06 19:14:40.626388 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.626352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea5318ce-7909-4c95-8c9a-315f25cc7f52-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.626388 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.626386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea5318ce-7909-4c95-8c9a-315f25cc7f52-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.626619 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.626483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5318ce-7909-4c95-8c9a-315f25cc7f52-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.626619 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.626517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea5318ce-7909-4c95-8c9a-315f25cc7f52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.626619 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.626598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwhk7\" (UniqueName: \"kubernetes.io/projected/ea5318ce-7909-4c95-8c9a-315f25cc7f52-kube-api-access-fwhk7\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.668792 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.668716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:40.727621 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.727588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwhk7\" (UniqueName: \"kubernetes.io/projected/ea5318ce-7909-4c95-8c9a-315f25cc7f52-kube-api-access-fwhk7\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.727787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.727639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea5318ce-7909-4c95-8c9a-315f25cc7f52-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.727787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.727662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea5318ce-7909-4c95-8c9a-315f25cc7f52-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.727787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.727717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5318ce-7909-4c95-8c9a-315f25cc7f52-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.727787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.727758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea5318ce-7909-4c95-8c9a-315f25cc7f52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.728056 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.728031 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea5318ce-7909-4c95-8c9a-315f25cc7f52-manifests\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.730063 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.730028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea5318ce-7909-4c95-8c9a-315f25cc7f52-tmp\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.730193 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.730175 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5318ce-7909-4c95-8c9a-315f25cc7f52-webhook-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.730309 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.730290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea5318ce-7909-4c95-8c9a-315f25cc7f52-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.748877 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.748851 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwhk7\" (UniqueName: \"kubernetes.io/projected/ea5318ce-7909-4c95-8c9a-315f25cc7f52-kube-api-access-fwhk7\") pod \"opendatahub-operator-controller-manager-b48f9c585-cp96s\" (UID: \"ea5318ce-7909-4c95-8c9a-315f25cc7f52\") " pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.764605 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.764579 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:40.858547 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.858515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:40.868834 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.868808 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:40.961991 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:40.961963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:41.019834 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:41.019790 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s"] Jul 06 19:14:41.066573 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:41.066542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:41.164352 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:41.164315 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:41.283294 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:41.283255 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:41.532209 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:41.532169 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:41.623254 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:41.623145 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:14:41.798842 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:41.798803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" event={"ID":"ea5318ce-7909-4c95-8c9a-315f25cc7f52","Type":"ContainerStarted","Data":"8b22b237e596fcf8a5a71f96630ae84346822cd92612593e12b70fc531e4e725"} Jul 06 19:14:44.814852 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:44.814817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" event={"ID":"ea5318ce-7909-4c95-8c9a-315f25cc7f52","Type":"ContainerStarted","Data":"cf69eaa6619d3e0f5f755bebe1096a21cce549d4b9d4bc57ab1dfe57c2f4a8e0"} Jul 06 19:14:45.821620 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:45.821587 2581 generic.go:356] "Generic (PLEG): container finished" podID="ea5318ce-7909-4c95-8c9a-315f25cc7f52" containerID="cf69eaa6619d3e0f5f755bebe1096a21cce549d4b9d4bc57ab1dfe57c2f4a8e0" exitCode=0 Jul 06 19:14:45.822021 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:45.821673 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" event={"ID":"ea5318ce-7909-4c95-8c9a-315f25cc7f52","Type":"ContainerDied","Data":"cf69eaa6619d3e0f5f755bebe1096a21cce549d4b9d4bc57ab1dfe57c2f4a8e0"} Jul 06 19:14:46.827959 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:46.827922 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" event={"ID":"ea5318ce-7909-4c95-8c9a-315f25cc7f52","Type":"ContainerStarted","Data":"515e68791cf0cc3572df81bc46fd8ed450af96b6243eb3831a7b8b9f9b519282"} Jul 06 19:14:46.828335 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:46.828038 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:14:46.854174 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:46.854134 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" podStartSLOduration=2.724335617 podStartE2EDuration="6.854121012s" totalImagesPullingTime="3.081010913s" totalInitContainerRuntime="1.048774482s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:46.85227909 +0000 UTC m=+562.941603259" watchObservedRunningTime="2026-07-06 19:14:46.854121012 +0000 UTC m=+562.943445170" Jul 06 19:14:57.835194 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:14:57.835161 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b48f9c585-cp96s" Jul 06 19:15:00.074189 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:00.074153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:02.001331 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:02.001295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:02.350655 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:02.350571 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:02.804196 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:02.804161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:02.973001 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:02.972968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:04.407316 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:04.407273 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:07.292618 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:07.292583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:07.408357 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:07.408324 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:08.775166 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.775138 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:08.882423 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.882389 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-689b9cdffd-96827"] Jul 06 19:15:08.882619 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.882569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:08.889270 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.889247 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:08.893340 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.893320 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 19:15:08.895249 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.895233 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 19:15:08.896555 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.896538 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 19:15:08.897026 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.897007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lgfm6\"" Jul 06 19:15:08.901575 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.901556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-689b9cdffd-96827"] Jul 06 19:15:08.983204 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.983170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36df7164-2c26-4385-829b-ad23c382f938-manager-config\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:08.983396 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.983212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36df7164-2c26-4385-829b-ad23c382f938-cert\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:08.983396 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.983280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwtqp\" (UniqueName: \"kubernetes.io/projected/36df7164-2c26-4385-829b-ad23c382f938-kube-api-access-mwtqp\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:08.983396 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:08.983326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36df7164-2c26-4385-829b-ad23c382f938-metrics-cert\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.083902 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.083811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36df7164-2c26-4385-829b-ad23c382f938-manager-config\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.083902 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.083857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36df7164-2c26-4385-829b-ad23c382f938-cert\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.083902 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.083887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwtqp\" (UniqueName: \"kubernetes.io/projected/36df7164-2c26-4385-829b-ad23c382f938-kube-api-access-mwtqp\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.084179 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.083907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36df7164-2c26-4385-829b-ad23c382f938-metrics-cert\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.084452 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.084419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36df7164-2c26-4385-829b-ad23c382f938-manager-config\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.086417 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.086394 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36df7164-2c26-4385-829b-ad23c382f938-metrics-cert\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.086538 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.086397 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36df7164-2c26-4385-829b-ad23c382f938-cert\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.115210 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.115177 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwtqp\" (UniqueName: \"kubernetes.io/projected/36df7164-2c26-4385-829b-ad23c382f938-kube-api-access-mwtqp\") pod \"lws-controller-manager-689b9cdffd-96827\" (UID: \"36df7164-2c26-4385-829b-ad23c382f938\") " pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.168697 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.168650 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:09.199321 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.199283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:09.473076 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:15:09.473041 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36df7164_2c26_4385_829b_ad23c382f938.slice/crio-99ff12026ca7285f80b98725a272ab72b533687630342d3c1531d72ca36752d5 WatchSource:0}: Error finding container 99ff12026ca7285f80b98725a272ab72b533687630342d3c1531d72ca36752d5: Status 404 returned error can't find the container with id 99ff12026ca7285f80b98725a272ab72b533687630342d3c1531d72ca36752d5 Jul 06 19:15:09.474043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.474018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-689b9cdffd-96827"] Jul 06 19:15:09.939796 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:09.939704 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" event={"ID":"36df7164-2c26-4385-829b-ad23c382f938","Type":"ContainerStarted","Data":"99ff12026ca7285f80b98725a272ab72b533687630342d3c1531d72ca36752d5"} Jul 06 19:15:10.946628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:10.946589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" event={"ID":"36df7164-2c26-4385-829b-ad23c382f938","Type":"ContainerStarted","Data":"8b40504821e4020c99ffe0ef7dfb9c60c9668b49f2812e094d8050f82ff3743f"} Jul 06 19:15:10.947008 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:10.946710 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:10.978348 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:10.978291 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" podStartSLOduration=1.747068998 podStartE2EDuration="2.978274392s" totalImagesPullingTime="1.231205394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:10.975642303 +0000 UTC m=+587.064966461" watchObservedRunningTime="2026-07-06 19:15:10.978274392 +0000 UTC m=+587.067598548" Jul 06 19:15:12.259515 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.259482 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2"] Jul 06 19:15:12.262151 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.262130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.300889 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.300859 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 19:15:12.303443 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.303425 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 19:15:12.304071 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.304057 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:15:12.305075 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.305060 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:15:12.305166 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.305144 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 19:15:12.308072 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.308050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a8fae48-9541-4306-82d0-a582b89e4f43-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.308169 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.308094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.308169 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.308124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.308169 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.308150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.308291 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.308186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.308291 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.308234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.308367 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.308289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q8vb\" (UniqueName: \"kubernetes.io/projected/1a8fae48-9541-4306-82d0-a582b89e4f43-kube-api-access-6q8vb\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.331398 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.331367 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:15:12.332444 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.332419 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jxzxl\"" Jul 06 19:15:12.335375 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.335353 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2"] Jul 06 19:15:12.409401 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.409361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q8vb\" (UniqueName: \"kubernetes.io/projected/1a8fae48-9541-4306-82d0-a582b89e4f43-kube-api-access-6q8vb\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.409401 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.409407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a8fae48-9541-4306-82d0-a582b89e4f43-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.409725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.409432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.409725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.409517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.409725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.409555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.409725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.409603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.409725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.409654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.410217 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.410189 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.411767 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.411740 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a8fae48-9541-4306-82d0-a582b89e4f43-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.411984 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.411967 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.412030 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.412001 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.412111 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.412091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.459411 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.459381 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q8vb\" (UniqueName: \"kubernetes.io/projected/1a8fae48-9541-4306-82d0-a582b89e4f43-kube-api-access-6q8vb\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.467002 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.466970 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a8fae48-9541-4306-82d0-a582b89e4f43-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sqlv2\" (UID: \"1a8fae48-9541-4306-82d0-a582b89e4f43\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.571048 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.570958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:12.722854 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.722829 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2"] Jul 06 19:15:12.725005 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:15:12.724981 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8fae48_9541_4306_82d0_a582b89e4f43.slice/crio-6d0384f8f7ead38a1b9caa8cc3bfe0c4197b332ec379a29d19fc34260b35b8e6 WatchSource:0}: Error finding container 6d0384f8f7ead38a1b9caa8cc3bfe0c4197b332ec379a29d19fc34260b35b8e6: Status 404 returned error can't find the container with id 6d0384f8f7ead38a1b9caa8cc3bfe0c4197b332ec379a29d19fc34260b35b8e6 Jul 06 19:15:12.956124 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:12.956037 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" event={"ID":"1a8fae48-9541-4306-82d0-a582b89e4f43","Type":"ContainerStarted","Data":"6d0384f8f7ead38a1b9caa8cc3bfe0c4197b332ec379a29d19fc34260b35b8e6"} Jul 06 19:15:14.945322 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:14.945281 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:15:14.945642 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:14.945353 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:15:15.974767 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:15.974730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" event={"ID":"1a8fae48-9541-4306-82d0-a582b89e4f43","Type":"ContainerStarted","Data":"d6592535b2d453a81e1b9b845852c51c8cf4eec4feec0c1f1034eeb1e5c2f747"} Jul 06 19:15:15.975163 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:15.974813 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:16.208264 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:16.208212 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" podStartSLOduration=1.99006849 podStartE2EDuration="4.208197291s" totalImagesPullingTime="2.218128801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:16.204550698 +0000 UTC m=+592.293874856" watchObservedRunningTime="2026-07-06 19:15:16.208197291 +0000 UTC m=+592.297521447" Jul 06 19:15:16.523220 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:16.523188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:16.614254 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:16.614221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:16.740377 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:16.740333 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:16.981302 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:16.981275 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sqlv2" Jul 06 19:15:17.180605 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:17.180576 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:18.012715 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:18.012681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:18.202979 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:18.202952 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:18.308672 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:18.308584 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:15:21.953200 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:21.953171 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:15:46.666976 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:15:46.666890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:01.581117 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:01.581082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:01.687433 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:01.687399 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:01.866354 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:01.866267 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:02.562772 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:02.562737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:02.744292 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:02.744261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:26.731355 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:26.731290 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:29.993171 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:29.993136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:35.297660 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:35.297627 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:36.843160 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:36.843122 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:37.907280 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:37.907249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:38.177955 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:38.177871 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:38.664513 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:38.664456 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:39.961801 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:39.961769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:40.852615 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:40.852578 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:40.952684 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:40.952644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:42.559607 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:42.559569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:42.666234 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:42.666195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:43.512652 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:43.512613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:43.611566 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:43.611527 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:43.716755 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:43.716728 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:43.820733 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:43.820639 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:44.575832 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:44.575795 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:44.764719 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:44.764676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:44.869997 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:44.869921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:45.246889 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:45.246846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:45.355431 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:45.355393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:47.612624 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:47.612589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:47.717973 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:47.717938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:54.266165 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:54.266133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:54.367674 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:54.367634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:56.031274 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:56.031240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:56.177881 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:56.177849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:58.960516 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:58.960485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:59.067549 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:59.067512 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:16:59.173160 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:16:59.173121 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:01.611825 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:01.611790 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:01.713312 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:01.713284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:04.979135 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:04.979098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:05.080720 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:05.080686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:12.044958 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:12.044924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:12.155884 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:12.155846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:16.836043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:16.835964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:16.936535 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:16.936502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:19.444735 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:19.444707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:19.545553 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:19.545522 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:23.266365 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:23.266329 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:23.370771 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:23.370736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:32.452285 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:32.452249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:32.558021 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:32.557986 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:36.404116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:36.404085 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:36.505013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:36.504977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:36.609429 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:36.609396 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:37.480713 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:37.480677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:37.846282 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:37.846203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:43.285357 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.285313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:43.305864 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.305831 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-67rkl"] Jul 06 19:17:43.309401 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.309384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:43.313609 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.313588 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:17:43.313765 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.313750 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-btkqm\"" Jul 06 19:17:43.314246 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.314230 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 19:17:43.317740 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.317718 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:17:43.333818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.333791 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-67rkl"] Jul 06 19:17:43.395651 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.395617 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-67rkl"] Jul 06 19:17:43.400057 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.400032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:43.402219 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.402199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdkh9\" (UniqueName: \"kubernetes.io/projected/72446529-1610-4f57-bda4-b7cdc5bef4e0-kube-api-access-cdkh9\") pod \"limitador-limitador-64c94fd64f-67rkl\" (UID: \"72446529-1610-4f57-bda4-b7cdc5bef4e0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:43.402289 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.402235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72446529-1610-4f57-bda4-b7cdc5bef4e0-config-file\") pod \"limitador-limitador-64c94fd64f-67rkl\" (UID: \"72446529-1610-4f57-bda4-b7cdc5bef4e0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:43.501513 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.501456 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:43.503683 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.503659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdkh9\" (UniqueName: \"kubernetes.io/projected/72446529-1610-4f57-bda4-b7cdc5bef4e0-kube-api-access-cdkh9\") pod \"limitador-limitador-64c94fd64f-67rkl\" (UID: \"72446529-1610-4f57-bda4-b7cdc5bef4e0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:43.503772 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.503699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72446529-1610-4f57-bda4-b7cdc5bef4e0-config-file\") pod \"limitador-limitador-64c94fd64f-67rkl\" (UID: \"72446529-1610-4f57-bda4-b7cdc5bef4e0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:43.504374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.504355 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72446529-1610-4f57-bda4-b7cdc5bef4e0-config-file\") pod \"limitador-limitador-64c94fd64f-67rkl\" (UID: \"72446529-1610-4f57-bda4-b7cdc5bef4e0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:43.520957 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.520928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdkh9\" (UniqueName: \"kubernetes.io/projected/72446529-1610-4f57-bda4-b7cdc5bef4e0-kube-api-access-cdkh9\") pod \"limitador-limitador-64c94fd64f-67rkl\" (UID: \"72446529-1610-4f57-bda4-b7cdc5bef4e0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:43.619669 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.619577 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:43.776208 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.776183 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-67rkl"] Jul 06 19:17:43.778528 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:17:43.778493 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72446529_1610_4f57_bda4_b7cdc5bef4e0.slice/crio-b12410694ae60e574ae115491176134f60c90ef13a88bb531ced80064475aabf WatchSource:0}: Error finding container b12410694ae60e574ae115491176134f60c90ef13a88bb531ced80064475aabf: Status 404 returned error can't find the container with id b12410694ae60e574ae115491176134f60c90ef13a88bb531ced80064475aabf Jul 06 19:17:43.780511 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:43.780494 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:17:44.432870 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:44.432834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:44.531591 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:44.531506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:17:44.678258 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:44.678219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" event={"ID":"72446529-1610-4f57-bda4-b7cdc5bef4e0","Type":"ContainerStarted","Data":"b12410694ae60e574ae115491176134f60c90ef13a88bb531ced80064475aabf"} Jul 06 19:17:46.689601 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:46.689565 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" event={"ID":"72446529-1610-4f57-bda4-b7cdc5bef4e0","Type":"ContainerStarted","Data":"b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b"} Jul 06 19:17:46.690011 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:46.689676 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:57.695434 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:57.695401 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:57.732217 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:57.732163 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" podStartSLOduration=12.054207773 podStartE2EDuration="14.732146256s" totalImagesPullingTime="2.677938483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:46.712992782 +0000 UTC m=+742.802316939" watchObservedRunningTime="2026-07-06 19:17:57.732146256 +0000 UTC m=+753.821470412" Jul 06 19:17:59.009432 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.009395 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-67rkl"] Jul 06 19:17:59.009934 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.009643 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" podUID="72446529-1610-4f57-bda4-b7cdc5bef4e0" containerName="limitador" containerID="cri-o://b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b" gracePeriod=30 Jul 06 19:17:59.563517 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.563483 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:59.657790 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.657686 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72446529-1610-4f57-bda4-b7cdc5bef4e0-config-file\") pod \"72446529-1610-4f57-bda4-b7cdc5bef4e0\" (UID: \"72446529-1610-4f57-bda4-b7cdc5bef4e0\") " Jul 06 19:17:59.657956 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.657805 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdkh9\" (UniqueName: \"kubernetes.io/projected/72446529-1610-4f57-bda4-b7cdc5bef4e0-kube-api-access-cdkh9\") pod \"72446529-1610-4f57-bda4-b7cdc5bef4e0\" (UID: \"72446529-1610-4f57-bda4-b7cdc5bef4e0\") " Jul 06 19:17:59.658121 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.658099 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72446529-1610-4f57-bda4-b7cdc5bef4e0-config-file" (OuterVolumeSpecName: "config-file") pod "72446529-1610-4f57-bda4-b7cdc5bef4e0" (UID: "72446529-1610-4f57-bda4-b7cdc5bef4e0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:17:59.660035 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.660006 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72446529-1610-4f57-bda4-b7cdc5bef4e0-kube-api-access-cdkh9" (OuterVolumeSpecName: "kube-api-access-cdkh9") pod "72446529-1610-4f57-bda4-b7cdc5bef4e0" (UID: "72446529-1610-4f57-bda4-b7cdc5bef4e0"). InnerVolumeSpecName "kube-api-access-cdkh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:17:59.751547 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.751515 2581 generic.go:356] "Generic (PLEG): container finished" podID="72446529-1610-4f57-bda4-b7cdc5bef4e0" containerID="b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b" exitCode=0 Jul 06 19:17:59.751743 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.751562 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" Jul 06 19:17:59.751743 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.751598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" event={"ID":"72446529-1610-4f57-bda4-b7cdc5bef4e0","Type":"ContainerDied","Data":"b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b"} Jul 06 19:17:59.751743 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.751658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-67rkl" event={"ID":"72446529-1610-4f57-bda4-b7cdc5bef4e0","Type":"ContainerDied","Data":"b12410694ae60e574ae115491176134f60c90ef13a88bb531ced80064475aabf"} Jul 06 19:17:59.751743 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.751688 2581 scope.go:117] "RemoveContainer" containerID="b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b" Jul 06 19:17:59.758520 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.758491 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdkh9\" (UniqueName: \"kubernetes.io/projected/72446529-1610-4f57-bda4-b7cdc5bef4e0-kube-api-access-cdkh9\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:17:59.758520 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.758517 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72446529-1610-4f57-bda4-b7cdc5bef4e0-config-file\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:17:59.760831 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.760795 2581 scope.go:117] "RemoveContainer" containerID="b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b" Jul 06 19:17:59.761141 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:17:59.761121 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b\": container with ID starting with b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b not found: ID does not exist" containerID="b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b" Jul 06 19:17:59.761211 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.761150 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b"} err="failed to get container status \"b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b\": rpc error: code = NotFound desc = could not find container \"b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b\": container with ID starting with b8e2698a8b77ed5cd1462de62004f4cca8bbc992c7ff7275272d49658c31a62b not found: ID does not exist" Jul 06 19:17:59.783642 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.783591 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-67rkl"] Jul 06 19:17:59.784375 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:17:59.784330 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-67rkl"] Jul 06 19:18:00.716534 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:00.716493 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72446529-1610-4f57-bda4-b7cdc5bef4e0" path="/var/lib/kubelet/pods/72446529-1610-4f57-bda4-b7cdc5bef4e0/volumes" Jul 06 19:18:04.873908 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.873868 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ntd2r"] Jul 06 19:18:04.874498 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.874415 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72446529-1610-4f57-bda4-b7cdc5bef4e0" containerName="limitador" Jul 06 19:18:04.874498 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.874433 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72446529-1610-4f57-bda4-b7cdc5bef4e0" containerName="limitador" Jul 06 19:18:04.874592 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.874506 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72446529-1610-4f57-bda4-b7cdc5bef4e0" containerName="limitador" Jul 06 19:18:04.880541 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.880521 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:04.884359 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.884329 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 19:18:04.884615 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.884595 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xbv8t\"" Jul 06 19:18:04.888771 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.888749 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ntd2r"] Jul 06 19:18:04.905731 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:04.905678 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:05.010371 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.010333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc9k7\" (UniqueName: \"kubernetes.io/projected/7dba16af-9006-4400-bd0c-e3d7ad434456-kube-api-access-sc9k7\") pod \"postgres-69fb4594cf-ntd2r\" (UID: \"7dba16af-9006-4400-bd0c-e3d7ad434456\") " pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:05.010371 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.010378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dba16af-9006-4400-bd0c-e3d7ad434456-data\") pod \"postgres-69fb4594cf-ntd2r\" (UID: \"7dba16af-9006-4400-bd0c-e3d7ad434456\") " pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:05.112138 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.112089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc9k7\" (UniqueName: \"kubernetes.io/projected/7dba16af-9006-4400-bd0c-e3d7ad434456-kube-api-access-sc9k7\") pod \"postgres-69fb4594cf-ntd2r\" (UID: \"7dba16af-9006-4400-bd0c-e3d7ad434456\") " pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:05.112344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.112173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dba16af-9006-4400-bd0c-e3d7ad434456-data\") pod \"postgres-69fb4594cf-ntd2r\" (UID: \"7dba16af-9006-4400-bd0c-e3d7ad434456\") " pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:05.112691 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.112668 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7dba16af-9006-4400-bd0c-e3d7ad434456-data\") pod \"postgres-69fb4594cf-ntd2r\" (UID: \"7dba16af-9006-4400-bd0c-e3d7ad434456\") " pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:05.131954 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.131877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc9k7\" (UniqueName: \"kubernetes.io/projected/7dba16af-9006-4400-bd0c-e3d7ad434456-kube-api-access-sc9k7\") pod \"postgres-69fb4594cf-ntd2r\" (UID: \"7dba16af-9006-4400-bd0c-e3d7ad434456\") " pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:05.192282 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.192251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:05.344013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.343989 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ntd2r"] Jul 06 19:18:05.346269 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:18:05.346238 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dba16af_9006_4400_bd0c_e3d7ad434456.slice/crio-3ad24e8354e5a45c865673ba1d05f9a15a48535c7cf7af5cb38a5d527c9970d1 WatchSource:0}: Error finding container 3ad24e8354e5a45c865673ba1d05f9a15a48535c7cf7af5cb38a5d527c9970d1: Status 404 returned error can't find the container with id 3ad24e8354e5a45c865673ba1d05f9a15a48535c7cf7af5cb38a5d527c9970d1 Jul 06 19:18:05.782932 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:05.782897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ntd2r" event={"ID":"7dba16af-9006-4400-bd0c-e3d7ad434456","Type":"ContainerStarted","Data":"3ad24e8354e5a45c865673ba1d05f9a15a48535c7cf7af5cb38a5d527c9970d1"} Jul 06 19:18:10.812517 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:10.812458 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ntd2r" event={"ID":"7dba16af-9006-4400-bd0c-e3d7ad434456","Type":"ContainerStarted","Data":"5e692cbe79746e93668383b2a66cc29ed3ee0f768098f90c70d7b1e6ad381cc9"} Jul 06 19:18:10.812988 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:10.812625 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:10.839281 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:10.839224 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ntd2r" podStartSLOduration=2.073604122 podStartE2EDuration="6.839205715s" totalImagesPullingTime="4.765601593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:10.834031761 +0000 UTC m=+766.923355918" watchObservedRunningTime="2026-07-06 19:18:10.839205715 +0000 UTC m=+766.928529872" Jul 06 19:18:15.382534 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:15.382503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:15.443571 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:15.443537 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:16.848314 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:16.848289 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ntd2r" Jul 06 19:18:17.264903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:17.264857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:17.711180 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:17.711135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:24.509253 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.509219 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:24.519041 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.519016 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-547f664844-cgmhp"] Jul 06 19:18:24.521737 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.521720 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:24.528242 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.528215 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 19:18:24.528354 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.528246 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 19:18:24.529143 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.529123 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cv44t\"" Jul 06 19:18:24.542340 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.542312 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-547f664844-cgmhp"] Jul 06 19:18:24.602452 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.602421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trdrr\" (UniqueName: \"kubernetes.io/projected/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-kube-api-access-trdrr\") pod \"maas-controller-547f664844-cgmhp\" (UID: \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\") " pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:24.602635 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.602534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-webhook-cert\") pod \"maas-controller-547f664844-cgmhp\" (UID: \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\") " pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:24.665697 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.665671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:24.703812 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.703778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trdrr\" (UniqueName: \"kubernetes.io/projected/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-kube-api-access-trdrr\") pod \"maas-controller-547f664844-cgmhp\" (UID: \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\") " pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:24.704020 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.703889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-webhook-cert\") pod \"maas-controller-547f664844-cgmhp\" (UID: \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\") " pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:24.706438 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.706404 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-webhook-cert\") pod \"maas-controller-547f664844-cgmhp\" (UID: \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\") " pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:24.717784 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.717760 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trdrr\" (UniqueName: \"kubernetes.io/projected/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-kube-api-access-trdrr\") pod \"maas-controller-547f664844-cgmhp\" (UID: \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\") " pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:24.763419 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.763334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:24.838223 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.838189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:24.981654 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:24.981629 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-547f664844-cgmhp"] Jul 06 19:18:24.983275 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:18:24.983248 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca0852f_9b79_4ea6_bf0c_5250affbbef5.slice/crio-ec8708a5cf717245354635d03c032be12b315c030eb76705bfdce13e619b7601 WatchSource:0}: Error finding container ec8708a5cf717245354635d03c032be12b315c030eb76705bfdce13e619b7601: Status 404 returned error can't find the container with id ec8708a5cf717245354635d03c032be12b315c030eb76705bfdce13e619b7601 Jul 06 19:18:25.892514 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:25.892458 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-547f664844-cgmhp" event={"ID":"3ca0852f-9b79-4ea6-bf0c-5250affbbef5","Type":"ContainerStarted","Data":"ec8708a5cf717245354635d03c032be12b315c030eb76705bfdce13e619b7601"} Jul 06 19:18:27.258394 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:27.258359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:27.375446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:27.375358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:27.904232 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:27.904195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-547f664844-cgmhp" event={"ID":"3ca0852f-9b79-4ea6-bf0c-5250affbbef5","Type":"ContainerStarted","Data":"dfa2aa82753805be18d433259517f38d7ff947b52246491471216f2522e6ab7d"} Jul 06 19:18:27.904426 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:27.904313 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:27.929804 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:27.929755 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-547f664844-cgmhp" podStartSLOduration=1.86916894 podStartE2EDuration="3.929738178s" totalImagesPullingTime="2.060569238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:27.927030293 +0000 UTC m=+784.016354452" watchObservedRunningTime="2026-07-06 19:18:27.929738178 +0000 UTC m=+784.019062344" Jul 06 19:18:38.770281 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:38.770244 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-547f664844-cgmhp"] Jul 06 19:18:38.770851 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:38.770482 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-547f664844-cgmhp" podUID="3ca0852f-9b79-4ea6-bf0c-5250affbbef5" containerName="manager" containerID="cri-o://dfa2aa82753805be18d433259517f38d7ff947b52246491471216f2522e6ab7d" gracePeriod=30 Jul 06 19:18:38.781174 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:38.781146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:38.956359 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:38.956323 2581 generic.go:356] "Generic (PLEG): container finished" podID="3ca0852f-9b79-4ea6-bf0c-5250affbbef5" containerID="dfa2aa82753805be18d433259517f38d7ff947b52246491471216f2522e6ab7d" exitCode=0 Jul 06 19:18:38.956550 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:38.956403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-547f664844-cgmhp" event={"ID":"3ca0852f-9b79-4ea6-bf0c-5250affbbef5","Type":"ContainerDied","Data":"dfa2aa82753805be18d433259517f38d7ff947b52246491471216f2522e6ab7d"} Jul 06 19:18:39.015051 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.015021 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:39.136378 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.136277 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-webhook-cert\") pod \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\" (UID: \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\") " Jul 06 19:18:39.136378 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.136354 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trdrr\" (UniqueName: \"kubernetes.io/projected/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-kube-api-access-trdrr\") pod \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\" (UID: \"3ca0852f-9b79-4ea6-bf0c-5250affbbef5\") " Jul 06 19:18:39.138619 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.138591 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3ca0852f-9b79-4ea6-bf0c-5250affbbef5" (UID: "3ca0852f-9b79-4ea6-bf0c-5250affbbef5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:18:39.138738 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.138701 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-kube-api-access-trdrr" (OuterVolumeSpecName: "kube-api-access-trdrr") pod "3ca0852f-9b79-4ea6-bf0c-5250affbbef5" (UID: "3ca0852f-9b79-4ea6-bf0c-5250affbbef5"). InnerVolumeSpecName "kube-api-access-trdrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:18:39.237365 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.237311 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trdrr\" (UniqueName: \"kubernetes.io/projected/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-kube-api-access-trdrr\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:18:39.237365 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.237351 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca0852f-9b79-4ea6-bf0c-5250affbbef5-webhook-cert\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:18:39.714062 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.714028 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:39.803967 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.803891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:18:39.962809 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.962778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-547f664844-cgmhp" event={"ID":"3ca0852f-9b79-4ea6-bf0c-5250affbbef5","Type":"ContainerDied","Data":"ec8708a5cf717245354635d03c032be12b315c030eb76705bfdce13e619b7601"} Jul 06 19:18:39.962991 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.962832 2581 scope.go:117] "RemoveContainer" containerID="dfa2aa82753805be18d433259517f38d7ff947b52246491471216f2522e6ab7d" Jul 06 19:18:39.962991 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.962792 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-547f664844-cgmhp" Jul 06 19:18:39.990473 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.990424 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-547f664844-cgmhp"] Jul 06 19:18:39.997843 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:39.997811 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-547f664844-cgmhp"] Jul 06 19:18:40.724258 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:40.724227 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca0852f-9b79-4ea6-bf0c-5250affbbef5" path="/var/lib/kubelet/pods/3ca0852f-9b79-4ea6-bf0c-5250affbbef5/volumes" Jul 06 19:18:59.819387 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:18:59.819348 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:00.388573 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.388545 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:00.439245 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.439210 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-d7888c7bf-mkdh5"] Jul 06 19:19:00.439662 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.439648 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca0852f-9b79-4ea6-bf0c-5250affbbef5" containerName="manager" Jul 06 19:19:00.439715 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.439664 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca0852f-9b79-4ea6-bf0c-5250affbbef5" containerName="manager" Jul 06 19:19:00.439755 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.439730 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca0852f-9b79-4ea6-bf0c-5250affbbef5" containerName="manager" Jul 06 19:19:00.445177 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.445156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.448560 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.448539 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 06 19:19:00.459288 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.459264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d7888c7bf-mkdh5"] Jul 06 19:19:00.548339 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.548303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9209b655-255d-4570-9793-fd332604738b-openshift-service-ca\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.548556 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.548384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6jpx\" (UniqueName: \"kubernetes.io/projected/9209b655-255d-4570-9793-fd332604738b-kube-api-access-v6jpx\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.548556 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.548512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9209b655-255d-4570-9793-fd332604738b-maas-api-tls\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.649968 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.649876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9209b655-255d-4570-9793-fd332604738b-openshift-service-ca\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.650123 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.650010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6jpx\" (UniqueName: \"kubernetes.io/projected/9209b655-255d-4570-9793-fd332604738b-kube-api-access-v6jpx\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.650123 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.650056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9209b655-255d-4570-9793-fd332604738b-maas-api-tls\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.650217 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:19:00.650157 2581 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 06 19:19:00.650268 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:19:00.650227 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9209b655-255d-4570-9793-fd332604738b-maas-api-tls podName:9209b655-255d-4570-9793-fd332604738b nodeName:}" failed. No retries permitted until 2026-07-06 19:19:01.150208229 +0000 UTC m=+817.239532366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9209b655-255d-4570-9793-fd332604738b-maas-api-tls") pod "maas-api-d7888c7bf-mkdh5" (UID: "9209b655-255d-4570-9793-fd332604738b") : secret "maas-api-serving-cert" not found Jul 06 19:19:00.650788 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.650767 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9209b655-255d-4570-9793-fd332604738b-openshift-service-ca\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.661726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.661700 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6jpx\" (UniqueName: \"kubernetes.io/projected/9209b655-255d-4570-9793-fd332604738b-kube-api-access-v6jpx\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:00.972155 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:00.972113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:01.067329 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.067283 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:01.155272 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.155237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9209b655-255d-4570-9793-fd332604738b-maas-api-tls\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:01.157697 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.157678 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9209b655-255d-4570-9793-fd332604738b-maas-api-tls\") pod \"maas-api-d7888c7bf-mkdh5\" (UID: \"9209b655-255d-4570-9793-fd332604738b\") " pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:01.187020 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.186984 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-mzcxk"] Jul 06 19:19:01.191374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.191357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:01.194737 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.194719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rdd5f\"" Jul 06 19:19:01.196207 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.196193 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 19:19:01.202339 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.202314 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-mzcxk"] Jul 06 19:19:01.242416 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.242332 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wdmgr"] Jul 06 19:19:01.250657 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.250626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:01.264766 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.264737 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wdmgr"] Jul 06 19:19:01.355650 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.355617 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:01.356953 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.356932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj2j4\" (UniqueName: \"kubernetes.io/projected/13b5228a-555f-47a1-aa9a-758836669b42-kube-api-access-gj2j4\") pod \"payload-pre-processing-7964457696-mzcxk\" (UID: \"13b5228a-555f-47a1-aa9a-758836669b42\") " pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:01.357015 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.356963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7592f7e3-3eb7-4ff8-9c21-fa87091a8225-plugins-config-volume\") pod \"payload-processing-58f86c7798-wdmgr\" (UID: \"7592f7e3-3eb7-4ff8-9c21-fa87091a8225\") " pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:01.357015 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.356992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13b5228a-555f-47a1-aa9a-758836669b42-plugins-config-volume\") pod \"payload-pre-processing-7964457696-mzcxk\" (UID: \"13b5228a-555f-47a1-aa9a-758836669b42\") " pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:01.357116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.357016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9rt\" (UniqueName: \"kubernetes.io/projected/7592f7e3-3eb7-4ff8-9c21-fa87091a8225-kube-api-access-6l9rt\") pod \"payload-processing-58f86c7798-wdmgr\" (UID: \"7592f7e3-3eb7-4ff8-9c21-fa87091a8225\") " pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:01.458155 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.458126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj2j4\" (UniqueName: \"kubernetes.io/projected/13b5228a-555f-47a1-aa9a-758836669b42-kube-api-access-gj2j4\") pod \"payload-pre-processing-7964457696-mzcxk\" (UID: \"13b5228a-555f-47a1-aa9a-758836669b42\") " pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:01.458347 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.458167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7592f7e3-3eb7-4ff8-9c21-fa87091a8225-plugins-config-volume\") pod \"payload-processing-58f86c7798-wdmgr\" (UID: \"7592f7e3-3eb7-4ff8-9c21-fa87091a8225\") " pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:01.458347 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.458210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13b5228a-555f-47a1-aa9a-758836669b42-plugins-config-volume\") pod \"payload-pre-processing-7964457696-mzcxk\" (UID: \"13b5228a-555f-47a1-aa9a-758836669b42\") " pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:01.458347 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.458235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9rt\" (UniqueName: \"kubernetes.io/projected/7592f7e3-3eb7-4ff8-9c21-fa87091a8225-kube-api-access-6l9rt\") pod \"payload-processing-58f86c7798-wdmgr\" (UID: \"7592f7e3-3eb7-4ff8-9c21-fa87091a8225\") " pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:01.459133 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.459110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13b5228a-555f-47a1-aa9a-758836669b42-plugins-config-volume\") pod \"payload-pre-processing-7964457696-mzcxk\" (UID: \"13b5228a-555f-47a1-aa9a-758836669b42\") " pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:01.459240 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.459176 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7592f7e3-3eb7-4ff8-9c21-fa87091a8225-plugins-config-volume\") pod \"payload-processing-58f86c7798-wdmgr\" (UID: \"7592f7e3-3eb7-4ff8-9c21-fa87091a8225\") " pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:01.472148 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.472120 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9rt\" (UniqueName: \"kubernetes.io/projected/7592f7e3-3eb7-4ff8-9c21-fa87091a8225-kube-api-access-6l9rt\") pod \"payload-processing-58f86c7798-wdmgr\" (UID: \"7592f7e3-3eb7-4ff8-9c21-fa87091a8225\") " pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:01.475000 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.474974 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj2j4\" (UniqueName: \"kubernetes.io/projected/13b5228a-555f-47a1-aa9a-758836669b42-kube-api-access-gj2j4\") pod \"payload-pre-processing-7964457696-mzcxk\" (UID: \"13b5228a-555f-47a1-aa9a-758836669b42\") " pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:01.495755 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.495729 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d7888c7bf-mkdh5"] Jul 06 19:19:01.497768 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:19:01.497727 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9209b655_255d_4570_9793_fd332604738b.slice/crio-99169b8f0ea90e806cf09850a81d14946d02a49942a60ed5e772dbe4522fd4bd WatchSource:0}: Error finding container 99169b8f0ea90e806cf09850a81d14946d02a49942a60ed5e772dbe4522fd4bd: Status 404 returned error can't find the container with id 99169b8f0ea90e806cf09850a81d14946d02a49942a60ed5e772dbe4522fd4bd Jul 06 19:19:01.502542 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.502520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:01.561767 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.561441 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:01.654190 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.654158 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-mzcxk"] Jul 06 19:19:01.656372 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:19:01.656345 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b5228a_555f_47a1_aa9a_758836669b42.slice/crio-c4adab2bb1490d74ab8df54ce309bad37aea7451db30c57da8064430e4d52006 WatchSource:0}: Error finding container c4adab2bb1490d74ab8df54ce309bad37aea7451db30c57da8064430e4d52006: Status 404 returned error can't find the container with id c4adab2bb1490d74ab8df54ce309bad37aea7451db30c57da8064430e4d52006 Jul 06 19:19:01.711521 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:01.711494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wdmgr"] Jul 06 19:19:01.713313 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:19:01.713273 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7592f7e3_3eb7_4ff8_9c21_fa87091a8225.slice/crio-5885a6d8cc6cbe1c21c2b0d4b621fe1ac165249983fc82588b8cd63ea8165f8d WatchSource:0}: Error finding container 5885a6d8cc6cbe1c21c2b0d4b621fe1ac165249983fc82588b8cd63ea8165f8d: Status 404 returned error can't find the container with id 5885a6d8cc6cbe1c21c2b0d4b621fe1ac165249983fc82588b8cd63ea8165f8d Jul 06 19:19:02.071697 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:02.071656 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" event={"ID":"7592f7e3-3eb7-4ff8-9c21-fa87091a8225","Type":"ContainerStarted","Data":"5885a6d8cc6cbe1c21c2b0d4b621fe1ac165249983fc82588b8cd63ea8165f8d"} Jul 06 19:19:02.073082 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:02.073050 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d7888c7bf-mkdh5" event={"ID":"9209b655-255d-4570-9793-fd332604738b","Type":"ContainerStarted","Data":"99169b8f0ea90e806cf09850a81d14946d02a49942a60ed5e772dbe4522fd4bd"} Jul 06 19:19:02.074357 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:02.074329 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" event={"ID":"13b5228a-555f-47a1-aa9a-758836669b42","Type":"ContainerStarted","Data":"c4adab2bb1490d74ab8df54ce309bad37aea7451db30c57da8064430e4d52006"} Jul 06 19:19:04.085534 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:04.085483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" event={"ID":"13b5228a-555f-47a1-aa9a-758836669b42","Type":"ContainerStarted","Data":"c41ee4df24b69111db903cf087d2e44db5bd6547d71a76dcd7c2eb4ba377b54f"} Jul 06 19:19:04.086021 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:04.085557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:04.086924 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:04.086902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" event={"ID":"7592f7e3-3eb7-4ff8-9c21-fa87091a8225","Type":"ContainerStarted","Data":"efc824f0649a3d597abbe090c894604b5f69e4cfeeb02bb1d23ef22fc42bc14b"} Jul 06 19:19:04.087052 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:04.086952 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:04.088308 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:04.088290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d7888c7bf-mkdh5" event={"ID":"9209b655-255d-4570-9793-fd332604738b","Type":"ContainerStarted","Data":"a26a8c054ab667914704eff3f525d8665e3294569e08adb97fbebc856c5ad2f9"} Jul 06 19:19:04.088415 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:04.088402 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:04.112610 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:04.112558 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" podStartSLOduration=1.7023839010000001 podStartE2EDuration="3.112543792s" totalImagesPullingTime="1.410159891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:04.111114698 +0000 UTC m=+820.200438856" watchObservedRunningTime="2026-07-06 19:19:04.112543792 +0000 UTC m=+820.201867948" Jul 06 19:19:04.135927 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:04.135871 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-d7888c7bf-mkdh5" podStartSLOduration=2.517868433 podStartE2EDuration="4.135849462s" totalImagesPullingTime="1.617981029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:04.134600733 +0000 UTC m=+820.223924890" watchObservedRunningTime="2026-07-06 19:19:04.135849462 +0000 UTC m=+820.225173620" Jul 06 19:19:05.627867 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:05.627832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:05.702865 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:05.702832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:10.099745 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:10.099717 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-d7888c7bf-mkdh5" Jul 06 19:19:10.128424 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:10.128374 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" podStartSLOduration=7.772689905 podStartE2EDuration="9.128358313s" totalImagesPullingTime="1.355668408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:04.160935926 +0000 UTC m=+820.250260102" watchObservedRunningTime="2026-07-06 19:19:10.128358313 +0000 UTC m=+826.217682471" Jul 06 19:19:11.243785 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:11.243751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:11.333565 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:11.333527 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:15.096208 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:15.096162 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-wdmgr" Jul 06 19:19:15.096754 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:15.096536 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-mzcxk" Jul 06 19:19:23.562393 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:23.562348 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:40.444278 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.444242 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm"] Jul 06 19:19:40.449862 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.449839 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.455620 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.455596 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 19:19:40.455774 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.455609 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 19:19:40.466321 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.466297 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2bj8l\"" Jul 06 19:19:40.467010 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.466997 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 19:19:40.483822 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.483794 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm"] Jul 06 19:19:40.494505 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.494458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:40.629315 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.629277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.629315 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.629316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c4r6\" (UniqueName: \"kubernetes.io/projected/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-kube-api-access-9c4r6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.629635 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.629454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.629635 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.629532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.629635 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.629581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.629635 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.629629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.730903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.730869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.730903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.730905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.731145 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.730930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.731145 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.730949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c4r6\" (UniqueName: \"kubernetes.io/projected/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-kube-api-access-9c4r6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.731145 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.731015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.731145 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.731038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.731434 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.731404 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.731576 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.731438 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.731576 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.731523 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.733199 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.733170 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.733357 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.733340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.747230 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.747193 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c4r6\" (UniqueName: \"kubernetes.io/projected/fd5de704-e5f1-46d6-b3e8-1b44c6406e2b-kube-api-access-9c4r6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t6phm\" (UID: \"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.759901 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.759876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:40.913278 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:40.913071 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm"] Jul 06 19:19:40.916068 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:19:40.916040 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5de704_e5f1_46d6_b3e8_1b44c6406e2b.slice/crio-ab89cb9a4074493b6263503aad1341a098f048c603f412376a90c226ce2a2e6c WatchSource:0}: Error finding container ab89cb9a4074493b6263503aad1341a098f048c603f412376a90c226ce2a2e6c: Status 404 returned error can't find the container with id ab89cb9a4074493b6263503aad1341a098f048c603f412376a90c226ce2a2e6c Jul 06 19:19:41.272676 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:41.272607 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" event={"ID":"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b","Type":"ContainerStarted","Data":"ab89cb9a4074493b6263503aad1341a098f048c603f412376a90c226ce2a2e6c"} Jul 06 19:19:42.292192 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:42.292157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" event={"ID":"fd5de704-e5f1-46d6-b3e8-1b44c6406e2b","Type":"ContainerStarted","Data":"d39d6d3babb40762fa1d3a6bea3961fa22687164339643cd289bd1121c280fc6"} Jul 06 19:19:42.340619 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:42.340563 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" podStartSLOduration=1.300381429 podStartE2EDuration="2.340546311s" totalImagesPullingTime="1.040164882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:42.339482936 +0000 UTC m=+858.428807091" watchObservedRunningTime="2026-07-06 19:19:42.340546311 +0000 UTC m=+858.429870468" Jul 06 19:19:50.760746 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:50.760711 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:50.761143 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:50.760782 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:50.773310 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:50.773284 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:51.345845 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:51.345817 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t6phm" Jul 06 19:19:55.385998 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.385963 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv"] Jul 06 19:19:55.389280 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.389262 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.392086 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.392064 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 19:19:55.411925 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.411901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv"] Jul 06 19:19:55.420218 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.420193 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:19:55.468646 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.468615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.468819 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.468669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.468819 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.468691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a980d898-105c-46a4-9acf-a2aced7cf36a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.468819 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.468754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.468819 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.468779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.468819 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.468806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptgf\" (UniqueName: \"kubernetes.io/projected/a980d898-105c-46a4-9acf-a2aced7cf36a-kube-api-access-tptgf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570271 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570271 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570571 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptgf\" (UniqueName: \"kubernetes.io/projected/a980d898-105c-46a4-9acf-a2aced7cf36a-kube-api-access-tptgf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570571 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570571 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570571 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a980d898-105c-46a4-9acf-a2aced7cf36a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570827 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570727 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570827 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570765 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.570924 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.570899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.572629 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.572609 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a980d898-105c-46a4-9acf-a2aced7cf36a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.572864 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.572848 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a980d898-105c-46a4-9acf-a2aced7cf36a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.583042 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.583021 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptgf\" (UniqueName: \"kubernetes.io/projected/a980d898-105c-46a4-9acf-a2aced7cf36a-kube-api-access-tptgf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9fxv\" (UID: \"a980d898-105c-46a4-9acf-a2aced7cf36a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.699972 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.699877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:19:55.844278 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:55.844253 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv"] Jul 06 19:19:55.846497 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:19:55.846458 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda980d898_105c_46a4_9acf_a2aced7cf36a.slice/crio-5b6d2082355c5da0da308df73266deae8318f9fb3cd2395578705610b56944c2 WatchSource:0}: Error finding container 5b6d2082355c5da0da308df73266deae8318f9fb3cd2395578705610b56944c2: Status 404 returned error can't find the container with id 5b6d2082355c5da0da308df73266deae8318f9fb3cd2395578705610b56944c2 Jul 06 19:19:56.360632 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:56.360536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" event={"ID":"a980d898-105c-46a4-9acf-a2aced7cf36a","Type":"ContainerStarted","Data":"cd5175fa55a8ee9d026b563d9006803e9ae5d4d855f35f7acc7139828dda1b1d"} Jul 06 19:19:56.360864 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:56.360638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" event={"ID":"a980d898-105c-46a4-9acf-a2aced7cf36a","Type":"ContainerStarted","Data":"5b6d2082355c5da0da308df73266deae8318f9fb3cd2395578705610b56944c2"} Jul 06 19:19:56.385054 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:19:56.385007 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" podStartSLOduration=1.181727154 podStartE2EDuration="1.38499421s" totalImagesPullingTime="203.267056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:56.38307962 +0000 UTC m=+872.472403779" watchObservedRunningTime="2026-07-06 19:19:56.38499421 +0000 UTC m=+872.474318366" Jul 06 19:20:04.057939 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:04.057900 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:20:05.700192 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:05.700152 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:20:05.700654 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:05.700210 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:20:05.712876 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:05.712847 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:20:06.423586 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:06.423557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9fxv" Jul 06 19:20:08.815784 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:08.815750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:20:23.133992 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:23.133919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:20:23.368672 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:23.368634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:20:23.455263 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:20:23.455184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:21:04.517258 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:21:04.517224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:21:04.617953 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:21:04.617917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:21:33.788372 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:21:33.788341 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:21:33.885069 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:21:33.885038 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:21:35.078406 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:21:35.078363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:21:35.179858 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:21:35.179826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:21:44.410782 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:21:44.410752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:22:00.933043 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:22:00.933012 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:22:51.498135 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:22:51.498100 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:22:52.946240 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:22:52.946206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:34.673154 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:34.673077 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:34.776129 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:34.776095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:34.932051 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:34.931975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:43.538128 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:43.538098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:43.674594 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:43.674559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:43.781821 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:43.781788 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:43.955196 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:43.955104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:51.516084 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:51.516053 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:51.608083 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:23:51.608051 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:25:43.774505 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:25:43.774442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:25:45.143092 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:25:45.143061 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:27:43.128732 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:27:43.128700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:28:46.378232 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:28:46.378192 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:29:40.503690 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:29:40.503609 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:29:40.566165 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:29:40.566133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:30:00.434062 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.434021 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-sjvqd"] Jul 06 19:30:00.437901 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.437880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" Jul 06 19:30:00.445846 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.445825 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\"" Jul 06 19:30:00.468323 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.468295 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-sjvqd"] Jul 06 19:30:00.515145 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.515102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sqvs\" (UniqueName: \"kubernetes.io/projected/65e73220-c8d4-44fa-80f1-5c17a5f9c1f6-kube-api-access-6sqvs\") pod \"maas-api-key-cleanup-29722770-sjvqd\" (UID: \"65e73220-c8d4-44fa-80f1-5c17a5f9c1f6\") " pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" Jul 06 19:30:00.615935 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.615903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sqvs\" (UniqueName: \"kubernetes.io/projected/65e73220-c8d4-44fa-80f1-5c17a5f9c1f6-kube-api-access-6sqvs\") pod \"maas-api-key-cleanup-29722770-sjvqd\" (UID: \"65e73220-c8d4-44fa-80f1-5c17a5f9c1f6\") " pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" Jul 06 19:30:00.638344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.638308 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sqvs\" (UniqueName: \"kubernetes.io/projected/65e73220-c8d4-44fa-80f1-5c17a5f9c1f6-kube-api-access-6sqvs\") pod \"maas-api-key-cleanup-29722770-sjvqd\" (UID: \"65e73220-c8d4-44fa-80f1-5c17a5f9c1f6\") " pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" Jul 06 19:30:00.748595 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.748557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" Jul 06 19:30:00.948084 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.948054 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-sjvqd"] Jul 06 19:30:00.953382 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:30:00.953352 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e73220_c8d4_44fa_80f1_5c17a5f9c1f6.slice/crio-824676e8e762847af76746acfae815198ed5b8db76dab972c5976a54627dd7c3 WatchSource:0}: Error finding container 824676e8e762847af76746acfae815198ed5b8db76dab972c5976a54627dd7c3: Status 404 returned error can't find the container with id 824676e8e762847af76746acfae815198ed5b8db76dab972c5976a54627dd7c3 Jul 06 19:30:00.955260 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:00.955240 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:30:01.399422 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:01.399386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" event={"ID":"65e73220-c8d4-44fa-80f1-5c17a5f9c1f6","Type":"ContainerStarted","Data":"824676e8e762847af76746acfae815198ed5b8db76dab972c5976a54627dd7c3"} Jul 06 19:30:05.421877 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:05.421842 2581 generic.go:356] "Generic (PLEG): container finished" podID="65e73220-c8d4-44fa-80f1-5c17a5f9c1f6" containerID="5a6d13ca2dda14b0421160d9417116ada37dc642a3a42dd5899ad8463d943489" exitCode=0 Jul 06 19:30:05.422284 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:05.421905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" event={"ID":"65e73220-c8d4-44fa-80f1-5c17a5f9c1f6","Type":"ContainerDied","Data":"5a6d13ca2dda14b0421160d9417116ada37dc642a3a42dd5899ad8463d943489"} Jul 06 19:30:06.564771 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:06.564737 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" Jul 06 19:30:06.678419 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:06.678377 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sqvs\" (UniqueName: \"kubernetes.io/projected/65e73220-c8d4-44fa-80f1-5c17a5f9c1f6-kube-api-access-6sqvs\") pod \"65e73220-c8d4-44fa-80f1-5c17a5f9c1f6\" (UID: \"65e73220-c8d4-44fa-80f1-5c17a5f9c1f6\") " Jul 06 19:30:06.680533 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:06.680435 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e73220-c8d4-44fa-80f1-5c17a5f9c1f6-kube-api-access-6sqvs" (OuterVolumeSpecName: "kube-api-access-6sqvs") pod "65e73220-c8d4-44fa-80f1-5c17a5f9c1f6" (UID: "65e73220-c8d4-44fa-80f1-5c17a5f9c1f6"). InnerVolumeSpecName "kube-api-access-6sqvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:06.779840 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:06.779800 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sqvs\" (UniqueName: \"kubernetes.io/projected/65e73220-c8d4-44fa-80f1-5c17a5f9c1f6-kube-api-access-6sqvs\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:30:07.435385 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:07.435346 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" event={"ID":"65e73220-c8d4-44fa-80f1-5c17a5f9c1f6","Type":"ContainerDied","Data":"824676e8e762847af76746acfae815198ed5b8db76dab972c5976a54627dd7c3"} Jul 06 19:30:07.435385 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:07.435375 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-sjvqd" Jul 06 19:30:07.435632 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:07.435404 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="824676e8e762847af76746acfae815198ed5b8db76dab972c5976a54627dd7c3" Jul 06 19:30:19.747735 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:19.747701 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:30:19.822790 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:19.822756 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:30:48.639154 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:30:48.639073 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:34:08.337344 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:34:08.337304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:34:48.271806 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:34:48.271768 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:34:57.971595 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:34:57.971549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:06.250733 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:06.250684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:11.419452 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:11.419420 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:14.469760 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:14.469725 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:14.550868 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:14.550842 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:14.982101 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:14.982062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:21.618680 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:21.618599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:21.685450 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:21.685416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:21.843182 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:21.843149 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:21.911331 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:21.911303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:23.052645 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:23.052615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:23.158837 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:23.158798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:23.253922 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:23.253871 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:23.632110 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:23.632077 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:23.810942 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:23.810907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:23.910270 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:23.910184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:26.171752 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:26.171695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:28.114846 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:28.114813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:28.307488 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:28.307426 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:28.418151 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:28.418069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:28.611832 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:28.611801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:29.876437 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:29.876404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:35.330759 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:35.330717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:35.403736 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:35.403704 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:35.586858 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:35.586771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:35.686693 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:35.686657 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:36.686639 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.686604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:36.762171 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.762135 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84"] Jul 06 19:35:36.762814 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.762794 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e73220-c8d4-44fa-80f1-5c17a5f9c1f6" containerName="cleanup" Jul 06 19:35:36.762872 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.762820 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e73220-c8d4-44fa-80f1-5c17a5f9c1f6" containerName="cleanup" Jul 06 19:35:36.762970 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.762958 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e73220-c8d4-44fa-80f1-5c17a5f9c1f6" containerName="cleanup" Jul 06 19:35:36.766650 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.766616 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.769168 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.769141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-66f608b7-serving-cert\"" Jul 06 19:35:36.769302 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.769282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\"" Jul 06 19:35:36.776137 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.775710 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84"] Jul 06 19:35:36.802847 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.802817 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:36.828657 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.828625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-maas-api-tls\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.828821 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.828671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-openshift-service-ca\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.828821 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.828785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29w4h\" (UniqueName: \"kubernetes.io/projected/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-kube-api-access-29w4h\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.903729 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.903677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:36.929788 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.929752 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-openshift-service-ca\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.929977 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.929821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29w4h\" (UniqueName: \"kubernetes.io/projected/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-kube-api-access-29w4h\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.929977 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.929932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-maas-api-tls\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.930446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.930425 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-openshift-service-ca\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.932329 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.932308 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-maas-api-tls\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:36.940638 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:36.940568 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29w4h\" (UniqueName: \"kubernetes.io/projected/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-kube-api-access-29w4h\") pod \"maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:37.003026 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:37.002983 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:37.079950 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:37.079919 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:37.219851 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:37.219825 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84"] Jul 06 19:35:37.222172 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:35:37.222145 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530a5241_ef21_4bc7_bd6d_9c0b24f2d811.slice/crio-497d46ad034258faa1313d6fe740b8dfdd735c4ce14eed8a014c753964a4f6ed WatchSource:0}: Error finding container 497d46ad034258faa1313d6fe740b8dfdd735c4ce14eed8a014c753964a4f6ed: Status 404 returned error can't find the container with id 497d46ad034258faa1313d6fe740b8dfdd735c4ce14eed8a014c753964a4f6ed Jul 06 19:35:37.223452 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:37.223436 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:35:37.293112 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:37.293085 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:37.396192 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:37.396158 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:38.083400 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:38.083367 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" event={"ID":"530a5241-ef21-4bc7-bd6d-9c0b24f2d811","Type":"ContainerStarted","Data":"dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8"} Jul 06 19:35:38.083860 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:38.083419 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" event={"ID":"530a5241-ef21-4bc7-bd6d-9c0b24f2d811","Type":"ContainerStarted","Data":"497d46ad034258faa1313d6fe740b8dfdd735c4ce14eed8a014c753964a4f6ed"} Jul 06 19:35:38.083860 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:38.083505 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:38.129886 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:38.129829 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" podStartSLOduration=1.7229308749999999 podStartE2EDuration="2.129810581s" totalImagesPullingTime="406.879706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:38.129131494 +0000 UTC m=+1814.218455669" watchObservedRunningTime="2026-07-06 19:35:38.129810581 +0000 UTC m=+1814.219134737" Jul 06 19:35:38.905568 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:38.905540 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:41.977996 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:41.977964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:42.483895 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.483854 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84"] Jul 06 19:35:42.484205 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.484145 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" podUID="530a5241-ef21-4bc7-bd6d-9c0b24f2d811" containerName="maas-api" containerID="cri-o://dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8" gracePeriod=30 Jul 06 19:35:42.489651 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.489631 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:42.521266 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.521240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:42.740229 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.740153 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:42.787717 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.787685 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-openshift-service-ca\") pod \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " Jul 06 19:35:42.787899 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.787783 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29w4h\" (UniqueName: \"kubernetes.io/projected/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-kube-api-access-29w4h\") pod \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " Jul 06 19:35:42.787899 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.787830 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-maas-api-tls\") pod \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\" (UID: \"530a5241-ef21-4bc7-bd6d-9c0b24f2d811\") " Jul 06 19:35:42.788026 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.788003 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "530a5241-ef21-4bc7-bd6d-9c0b24f2d811" (UID: "530a5241-ef21-4bc7-bd6d-9c0b24f2d811"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:42.788139 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.788125 2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-openshift-service-ca\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.789858 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.789830 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-kube-api-access-29w4h" (OuterVolumeSpecName: "kube-api-access-29w4h") pod "530a5241-ef21-4bc7-bd6d-9c0b24f2d811" (UID: "530a5241-ef21-4bc7-bd6d-9c0b24f2d811"). InnerVolumeSpecName "kube-api-access-29w4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:42.789968 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.789906 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "530a5241-ef21-4bc7-bd6d-9c0b24f2d811" (UID: "530a5241-ef21-4bc7-bd6d-9c0b24f2d811"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:35:42.889652 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.889616 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29w4h\" (UniqueName: \"kubernetes.io/projected/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-kube-api-access-29w4h\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:35:42.889810 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:42.889669 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530a5241-ef21-4bc7-bd6d-9c0b24f2d811-maas-api-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:35:43.110084 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.109999 2581 generic.go:356] "Generic (PLEG): container finished" podID="530a5241-ef21-4bc7-bd6d-9c0b24f2d811" containerID="dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8" exitCode=0 Jul 06 19:35:43.110084 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.110039 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" Jul 06 19:35:43.110084 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.110061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" event={"ID":"530a5241-ef21-4bc7-bd6d-9c0b24f2d811","Type":"ContainerDied","Data":"dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8"} Jul 06 19:35:43.110650 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.110101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84" event={"ID":"530a5241-ef21-4bc7-bd6d-9c0b24f2d811","Type":"ContainerDied","Data":"497d46ad034258faa1313d6fe740b8dfdd735c4ce14eed8a014c753964a4f6ed"} Jul 06 19:35:43.110650 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.110123 2581 scope.go:117] "RemoveContainer" containerID="dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8" Jul 06 19:35:43.119829 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.119812 2581 scope.go:117] "RemoveContainer" containerID="dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8" Jul 06 19:35:43.120088 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:35:43.120070 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8\": container with ID starting with dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8 not found: ID does not exist" containerID="dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8" Jul 06 19:35:43.120139 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.120097 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8"} err="failed to get container status \"dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8\": rpc error: code = NotFound desc = could not find container \"dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8\": container with ID starting with dbe5e5e1e7545623ae1242500119cfac02542da62f4f1440fbce2371ce4924c8 not found: ID does not exist" Jul 06 19:35:43.134393 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.134366 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84"] Jul 06 19:35:43.139733 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:43.139709 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-66f608b7-8d6b689cc-f5n84"] Jul 06 19:35:44.718544 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:44.718508 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="530a5241-ef21-4bc7-bd6d-9c0b24f2d811" path="/var/lib/kubelet/pods/530a5241-ef21-4bc7-bd6d-9c0b24f2d811/volumes" Jul 06 19:35:48.125608 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:48.125575 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:48.226214 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:48.226185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:49.920765 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:49.920738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:52.802278 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:52.802249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:52.874530 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:52.874499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:55.269379 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:55.269321 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:55.336699 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:55.336671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:55.505287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:55.505260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:55.573946 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:55.573835 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:56.727321 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.727295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:56.830050 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.830020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:56.854432 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.854405 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv"] Jul 06 19:35:56.854835 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.854822 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530a5241-ef21-4bc7-bd6d-9c0b24f2d811" containerName="maas-api" Jul 06 19:35:56.854835 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.854836 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="530a5241-ef21-4bc7-bd6d-9c0b24f2d811" containerName="maas-api" Jul 06 19:35:56.854941 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.854927 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="530a5241-ef21-4bc7-bd6d-9c0b24f2d811" containerName="maas-api" Jul 06 19:35:56.858108 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.858094 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:56.861791 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.861772 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-b394aded-serving-cert\"" Jul 06 19:35:56.862069 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.862051 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\"" Jul 06 19:35:56.890399 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.890373 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv"] Jul 06 19:35:56.935193 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:56.935160 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:57.010881 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.010783 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:57.028186 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.028159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc89f841-b4d9-4c78-ade3-9aa466b58199-maas-api-tls\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.028310 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.028199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc89f841-b4d9-4c78-ade3-9aa466b58199-openshift-service-ca\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.028310 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.028239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgj2\" (UniqueName: \"kubernetes.io/projected/cc89f841-b4d9-4c78-ade3-9aa466b58199-kube-api-access-tcgj2\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.129522 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.129477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc89f841-b4d9-4c78-ade3-9aa466b58199-maas-api-tls\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.129713 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.129548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc89f841-b4d9-4c78-ade3-9aa466b58199-openshift-service-ca\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.129713 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.129598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgj2\" (UniqueName: \"kubernetes.io/projected/cc89f841-b4d9-4c78-ade3-9aa466b58199-kube-api-access-tcgj2\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.130267 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.130243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc89f841-b4d9-4c78-ade3-9aa466b58199-openshift-service-ca\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.131920 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.131897 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc89f841-b4d9-4c78-ade3-9aa466b58199-maas-api-tls\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.141056 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.141029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgj2\" (UniqueName: \"kubernetes.io/projected/cc89f841-b4d9-4c78-ade3-9aa466b58199-kube-api-access-tcgj2\") pod \"maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.168903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.168874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:57.307651 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.307619 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv"] Jul 06 19:35:57.309752 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:35:57.309718 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc89f841_b4d9_4c78_ade3_9aa466b58199.slice/crio-d97c6304a09e82a9dbea283f4113bdbdbdded6cb157f177f4f01bbe77b8a196a WatchSource:0}: Error finding container d97c6304a09e82a9dbea283f4113bdbdbdded6cb157f177f4f01bbe77b8a196a: Status 404 returned error can't find the container with id d97c6304a09e82a9dbea283f4113bdbdbdded6cb157f177f4f01bbe77b8a196a Jul 06 19:35:57.422939 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.422898 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:57.522455 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:57.522424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:35:58.195064 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:58.195024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" event={"ID":"cc89f841-b4d9-4c78-ade3-9aa466b58199","Type":"ContainerStarted","Data":"be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55"} Jul 06 19:35:58.195537 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:58.195092 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:35:58.195537 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:58.195116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" event={"ID":"cc89f841-b4d9-4c78-ade3-9aa466b58199","Type":"ContainerStarted","Data":"d97c6304a09e82a9dbea283f4113bdbdbdded6cb157f177f4f01bbe77b8a196a"} Jul 06 19:35:58.214662 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:58.214615 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" podStartSLOduration=1.8400649100000002 podStartE2EDuration="2.214599209s" totalImagesPullingTime="374.534299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:58.21340268 +0000 UTC m=+1834.302726837" watchObservedRunningTime="2026-07-06 19:35:58.214599209 +0000 UTC m=+1834.303923422" Jul 06 19:35:58.997795 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:35:58.997764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:01.149656 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.149625 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:01.401156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.401075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:01.501954 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.501921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:01.656907 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.656817 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv"] Jul 06 19:36:01.657075 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.657031 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" podUID="cc89f841-b4d9-4c78-ade3-9aa466b58199" containerName="maas-api" containerID="cri-o://be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55" gracePeriod=30 Jul 06 19:36:01.683384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.683356 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:01.906562 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.906528 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:36:01.973295 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.973266 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc89f841-b4d9-4c78-ade3-9aa466b58199-openshift-service-ca\") pod \"cc89f841-b4d9-4c78-ade3-9aa466b58199\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " Jul 06 19:36:01.973503 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.973360 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcgj2\" (UniqueName: \"kubernetes.io/projected/cc89f841-b4d9-4c78-ade3-9aa466b58199-kube-api-access-tcgj2\") pod \"cc89f841-b4d9-4c78-ade3-9aa466b58199\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " Jul 06 19:36:01.973503 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.973431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc89f841-b4d9-4c78-ade3-9aa466b58199-maas-api-tls\") pod \"cc89f841-b4d9-4c78-ade3-9aa466b58199\" (UID: \"cc89f841-b4d9-4c78-ade3-9aa466b58199\") " Jul 06 19:36:01.973718 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.973694 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc89f841-b4d9-4c78-ade3-9aa466b58199-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc89f841-b4d9-4c78-ade3-9aa466b58199" (UID: "cc89f841-b4d9-4c78-ade3-9aa466b58199"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:36:01.973792 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.973775 2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc89f841-b4d9-4c78-ade3-9aa466b58199-openshift-service-ca\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:36:01.975475 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.975442 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc89f841-b4d9-4c78-ade3-9aa466b58199-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc89f841-b4d9-4c78-ade3-9aa466b58199" (UID: "cc89f841-b4d9-4c78-ade3-9aa466b58199"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:36:01.975593 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:01.975577 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc89f841-b4d9-4c78-ade3-9aa466b58199-kube-api-access-tcgj2" (OuterVolumeSpecName: "kube-api-access-tcgj2") pod "cc89f841-b4d9-4c78-ade3-9aa466b58199" (UID: "cc89f841-b4d9-4c78-ade3-9aa466b58199"). InnerVolumeSpecName "kube-api-access-tcgj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:36:02.074628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.074590 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcgj2\" (UniqueName: \"kubernetes.io/projected/cc89f841-b4d9-4c78-ade3-9aa466b58199-kube-api-access-tcgj2\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:36:02.074628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.074622 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc89f841-b4d9-4c78-ade3-9aa466b58199-maas-api-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:36:02.217066 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.217027 2581 generic.go:356] "Generic (PLEG): container finished" podID="cc89f841-b4d9-4c78-ade3-9aa466b58199" containerID="be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55" exitCode=0 Jul 06 19:36:02.217507 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.217076 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" Jul 06 19:36:02.217507 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.217073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" event={"ID":"cc89f841-b4d9-4c78-ade3-9aa466b58199","Type":"ContainerDied","Data":"be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55"} Jul 06 19:36:02.217507 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.217203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv" event={"ID":"cc89f841-b4d9-4c78-ade3-9aa466b58199","Type":"ContainerDied","Data":"d97c6304a09e82a9dbea283f4113bdbdbdded6cb157f177f4f01bbe77b8a196a"} Jul 06 19:36:02.217507 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.217230 2581 scope.go:117] "RemoveContainer" containerID="be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55" Jul 06 19:36:02.228717 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.228696 2581 scope.go:117] "RemoveContainer" containerID="be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55" Jul 06 19:36:02.229029 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:36:02.229007 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55\": container with ID starting with be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55 not found: ID does not exist" containerID="be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55" Jul 06 19:36:02.229093 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.229041 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55"} err="failed to get container status \"be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55\": rpc error: code = NotFound desc = could not find container \"be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55\": container with ID starting with be274297c14410838847768f348d73b2f2c8e2fe2fae3b18099bb7464ea28e55 not found: ID does not exist" Jul 06 19:36:02.250660 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.250625 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv"] Jul 06 19:36:02.259226 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.259199 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-b394aded-859d4f8c49-ppzdv"] Jul 06 19:36:02.723280 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:02.723241 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc89f841-b4d9-4c78-ade3-9aa466b58199" path="/var/lib/kubelet/pods/cc89f841-b4d9-4c78-ade3-9aa466b58199/volumes" Jul 06 19:36:05.165899 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:05.165870 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:08.090946 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:08.090904 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:08.188916 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:08.188888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:08.594975 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:08.594937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:08.686326 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:08.686275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:08.790131 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:08.790092 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:10.203913 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:10.203863 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:16.847540 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:16.847511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:16.917110 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:16.917079 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:17.008028 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:17.007989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:17.125220 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:17.125101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:17.226557 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:17.226502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:17.689289 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:17.689231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:43.651978 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:43.651941 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:50.297392 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:50.297366 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:50.364783 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:50.364727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:50.443533 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:50.443499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:50.544641 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:50.544612 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:36:55.570164 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:36:55.570129 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:06.451869 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:06.451833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:13.696036 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:13.695989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:13.832743 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:13.832699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:13.938077 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:13.938046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:22.497075 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:22.497041 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:24.435658 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:24.435627 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:25.261302 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:25.261274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:31.850296 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:31.850262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:31.951446 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:31.951398 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:32.048684 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:32.048653 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:32.150025 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:32.149920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:32.907210 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:32.907172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:33.008209 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:33.008120 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:33.075409 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:33.075380 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:34.728541 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:34.728511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:41.292000 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:41.291965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:41.393459 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:41.393432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:41.987640 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:41.987602 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:49.277102 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:49.277064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:49.385337 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:49.385305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:49.564564 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:49.564483 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:49.994918 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:49.994890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:50.560948 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:50.560917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:53.109168 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:53.109138 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:53.218759 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:53.218727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:53.295047 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:53.295015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:53.395705 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:53.395615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:53.823704 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:53.823657 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:53.924482 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:53.924438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:57.617302 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:57.617265 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:58.297726 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:58.297686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:58.435185 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:58.435155 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:37:58.797790 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:37:58.797753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:05.347723 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:05.347686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:05.467542 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:05.467504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:05.935451 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:05.935412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:06.306158 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:06.306129 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:06.390746 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:06.390714 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:12.863935 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:12.863903 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:12.964391 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:12.964358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:13.145668 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:13.145577 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:13.367794 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:13.367761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:13.489822 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:13.489781 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:13.590530 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:13.590494 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:13.713301 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:13.713268 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:16.159170 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:16.159090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:16.259456 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:16.259425 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:20.485610 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:20.485574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:20.546940 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:20.546908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:20.631675 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:20.631646 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:20.731123 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:20.731089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:20.846085 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:20.846005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:27.215015 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:27.214985 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:27.283433 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:27.283397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:34.182350 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:34.182313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:34.522105 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:34.522075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:35.291272 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:35.291221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:37.260960 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:37.260928 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:37.343294 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:37.343245 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:37.507899 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:37.507866 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:37.622896 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:37.622805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:38.108138 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:38.108096 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:38.207540 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:38.207493 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:41.792564 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:41.792528 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:38:49.613248 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:38:49.613216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:39:19.259723 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:39:19.259681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:39:19.680527 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:39:19.680423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:39:25.359891 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:39:25.359849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:39:30.440556 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:39:30.440521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:39:39.359519 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:39:39.359486 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:05.661585 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:05.661549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:07.387565 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:07.387525 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:13.970984 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:13.970944 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:14.038883 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:14.038846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:14.358586 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:14.358450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:14.877179 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:14.877123 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:16.516784 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:16.516743 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:16.614359 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:16.614326 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:16.719340 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:16.719287 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:17.547621 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:17.547582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:17.645927 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:17.645883 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:17.754561 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:17.754532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:19.237820 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:19.237783 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:26.492401 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:26.492366 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:26.592991 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:26.592957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:27.213718 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:27.213680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:34.067305 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:34.067272 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:34.171615 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:34.171586 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:34.291730 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:34.291698 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:44.851435 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:44.851403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:40:45.333861 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:40:45.333827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:06.194851 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:06.194815 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:07.613769 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:07.613737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:12.837548 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:12.837517 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:12.908060 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:12.908027 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:13.206780 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:13.206675 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:13.570722 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:13.570689 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:13.842768 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:13.842689 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:17.081189 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:17.081109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:17.176029 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:17.175991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:17.356144 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:17.356064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:17.527713 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:17.527682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:17.977071 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:17.977033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:18.077857 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:18.077819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:21.585274 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:21.585239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:21.928645 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:21.928558 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:22.237504 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:22.237474 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:22.383333 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:22.383302 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:25.166722 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:25.166690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:25.253408 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:25.253377 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:25.336141 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:25.336100 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:25.433257 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:25.433166 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:26.150064 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:26.150032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:26.263700 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:26.263670 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:29.577269 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:29.577234 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:38.861263 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:38.861223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:38.961532 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:38.961451 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:41.044207 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:41.044172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:47.151530 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:47.151491 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:41:47.250628 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:41:47.250595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:16.360505 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:16.360455 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:17.389128 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:17.389099 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:38.576906 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:38.576867 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:39.498664 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:39.498628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:39.653689 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:39.653644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:40.058329 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:40.058293 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:40.177427 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:40.177393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:40.278299 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:40.278270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:40.478484 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:40.478437 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:42:45.122899 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:42:45.122868 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:17.000647 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:17.000614 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:17.102510 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:17.102449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:23.167523 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:23.167456 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:23.436157 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:23.436067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:23.681379 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:23.681342 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:23.863672 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:23.863645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:24.271416 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:24.271374 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:24.388488 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:24.388437 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:24.488308 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:24.488254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:24.660752 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:24.660664 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:30.844541 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:30.844483 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:30.916591 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:30.916558 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:31.125743 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:31.125640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:31.351862 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:31.351833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:31.690746 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:31.690717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:32.037089 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:32.037045 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:32.230160 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:32.230118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:34.833283 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:34.833240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:34.936063 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:34.936027 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:35.037931 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:35.037903 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:35.141567 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:35.141478 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:35.559312 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:35.559271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:35.654638 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:35.654603 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:39.327136 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:39.327101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:39.804909 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:39.804876 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:40.145552 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:40.145458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:40.456804 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:40.456713 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:42.796596 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:42.796563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:42.904523 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:42.904476 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:43.074056 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:43.073967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:43.775685 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:43.775647 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:43.876792 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:43.876692 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:47.322578 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:47.322540 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:55.408244 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:55.408205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:55.767784 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:55.767752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:55.926123 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:55.926088 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:56.022083 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:56.021974 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:43:56.305100 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:43:56.304993 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:02.425816 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:02.425780 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:02.530812 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:02.530783 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:02.726952 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:02.726915 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:02.928834 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:02.928794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:03.158779 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:03.158677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:03.474807 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:03.474771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:03.575948 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:03.575922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:03.674635 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:03.674578 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:03.884700 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:03.884616 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:10.139803 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:10.139761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:10.240165 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:10.240133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:10.414763 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:10.414680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:10.645149 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:10.645115 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:10.742380 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:10.742347 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:11.033934 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:11.033850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:11.324119 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:11.324039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:11.557917 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:11.557887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:14.047949 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:14.047892 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:14.130666 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:14.130611 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:14.208949 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:14.208921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:14.464750 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:14.464678 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:14.661705 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:14.661680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:14.760980 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:14.760876 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:18.552507 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:18.552359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:18.884288 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:18.884202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:19.217310 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:19.217259 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:19.325610 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:19.325574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:22.092715 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:22.092654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:22.186667 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:22.186635 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:22.293570 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:22.293532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:22.431612 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:22.431529 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:22.533342 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:22.533305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:22.856965 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:22.856929 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:22.956252 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:22.956186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:26.598839 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:26.598797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:34.487562 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:34.487531 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:35.516051 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:35.516018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:35.617235 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:35.617188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:43.751248 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:43.751208 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:44:43.851922 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:44:43.851867 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:45:00.155631 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.155595 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-n65rf"] Jul 06 19:45:00.156118 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.156100 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc89f841-b4d9-4c78-ade3-9aa466b58199" containerName="maas-api" Jul 06 19:45:00.156169 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.156120 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc89f841-b4d9-4c78-ade3-9aa466b58199" containerName="maas-api" Jul 06 19:45:00.156204 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.156187 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc89f841-b4d9-4c78-ade3-9aa466b58199" containerName="maas-api" Jul 06 19:45:00.159524 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.159505 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl"] Jul 06 19:45:00.159656 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.159623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" Jul 06 19:45:00.162280 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.162261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nft28\"" Jul 06 19:45:00.162904 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.162888 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59"] Jul 06 19:45:00.163012 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.162997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" Jul 06 19:45:00.166167 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.166151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" Jul 06 19:45:00.171058 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.171037 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-n65rf"] Jul 06 19:45:00.174627 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.174605 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl"] Jul 06 19:45:00.192703 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.192678 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59"] Jul 06 19:45:00.262725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.262687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg86w\" (UniqueName: \"kubernetes.io/projected/30b9ef5b-8137-4a93-af57-83f3b99431e0-kube-api-access-rg86w\") pod \"maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl\" (UID: \"30b9ef5b-8137-4a93-af57-83f3b99431e0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" Jul 06 19:45:00.262916 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.262812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wr6f\" (UniqueName: \"kubernetes.io/projected/b7b0e74c-ca59-44a6-862c-5b4e854104c2-kube-api-access-6wr6f\") pod \"maas-api-key-cleanup-29722785-n65rf\" (UID: \"b7b0e74c-ca59-44a6-862c-5b4e854104c2\") " pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" Jul 06 19:45:00.262916 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.262873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgrg\" (UniqueName: \"kubernetes.io/projected/3e7f605f-c064-443c-a7bb-5f2a8c459cb8-kube-api-access-fkgrg\") pod \"maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59\" (UID: \"3e7f605f-c064-443c-a7bb-5f2a8c459cb8\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" Jul 06 19:45:00.363954 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.363909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wr6f\" (UniqueName: \"kubernetes.io/projected/b7b0e74c-ca59-44a6-862c-5b4e854104c2-kube-api-access-6wr6f\") pod \"maas-api-key-cleanup-29722785-n65rf\" (UID: \"b7b0e74c-ca59-44a6-862c-5b4e854104c2\") " pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" Jul 06 19:45:00.364173 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.364013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgrg\" (UniqueName: \"kubernetes.io/projected/3e7f605f-c064-443c-a7bb-5f2a8c459cb8-kube-api-access-fkgrg\") pod \"maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59\" (UID: \"3e7f605f-c064-443c-a7bb-5f2a8c459cb8\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" Jul 06 19:45:00.364173 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.364098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg86w\" (UniqueName: \"kubernetes.io/projected/30b9ef5b-8137-4a93-af57-83f3b99431e0-kube-api-access-rg86w\") pod \"maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl\" (UID: \"30b9ef5b-8137-4a93-af57-83f3b99431e0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" Jul 06 19:45:00.374749 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.374717 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg86w\" (UniqueName: \"kubernetes.io/projected/30b9ef5b-8137-4a93-af57-83f3b99431e0-kube-api-access-rg86w\") pod \"maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl\" (UID: \"30b9ef5b-8137-4a93-af57-83f3b99431e0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" Jul 06 19:45:00.374878 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.374820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgrg\" (UniqueName: \"kubernetes.io/projected/3e7f605f-c064-443c-a7bb-5f2a8c459cb8-kube-api-access-fkgrg\") pod \"maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59\" (UID: \"3e7f605f-c064-443c-a7bb-5f2a8c459cb8\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" Jul 06 19:45:00.374878 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.374828 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wr6f\" (UniqueName: \"kubernetes.io/projected/b7b0e74c-ca59-44a6-862c-5b4e854104c2-kube-api-access-6wr6f\") pod \"maas-api-key-cleanup-29722785-n65rf\" (UID: \"b7b0e74c-ca59-44a6-862c-5b4e854104c2\") " pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" Jul 06 19:45:00.472909 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.472883 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" Jul 06 19:45:00.482078 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.482043 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" Jul 06 19:45:00.488885 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.488857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" Jul 06 19:45:00.635439 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.635292 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-n65rf"] Jul 06 19:45:00.637293 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:45:00.637238 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b0e74c_ca59_44a6_862c_5b4e854104c2.slice/crio-6b2d2f1a171f8cf7c4cea10660fe63bd789a879c51f071172b292deab6a8dd21 WatchSource:0}: Error finding container 6b2d2f1a171f8cf7c4cea10660fe63bd789a879c51f071172b292deab6a8dd21: Status 404 returned error can't find the container with id 6b2d2f1a171f8cf7c4cea10660fe63bd789a879c51f071172b292deab6a8dd21 Jul 06 19:45:00.665712 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.665684 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl"] Jul 06 19:45:00.670720 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:45:00.670694 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b9ef5b_8137_4a93_af57_83f3b99431e0.slice/crio-12bb721a91b8ade282362cfe0e4a3d15c193ef102355e3d93815748836a17e5b WatchSource:0}: Error finding container 12bb721a91b8ade282362cfe0e4a3d15c193ef102355e3d93815748836a17e5b: Status 404 returned error can't find the container with id 12bb721a91b8ade282362cfe0e4a3d15c193ef102355e3d93815748836a17e5b Jul 06 19:45:00.686384 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.686364 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59"] Jul 06 19:45:00.688349 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:45:00.688326 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7f605f_c064_443c_a7bb_5f2a8c459cb8.slice/crio-f2e2c02163481b24688d0fa94f05144e0b17e1526e056df65344d214ea6f0606 WatchSource:0}: Error finding container f2e2c02163481b24688d0fa94f05144e0b17e1526e056df65344d214ea6f0606: Status 404 returned error can't find the container with id f2e2c02163481b24688d0fa94f05144e0b17e1526e056df65344d214ea6f0606 Jul 06 19:45:00.940382 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.940347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" event={"ID":"30b9ef5b-8137-4a93-af57-83f3b99431e0","Type":"ContainerStarted","Data":"12bb721a91b8ade282362cfe0e4a3d15c193ef102355e3d93815748836a17e5b"} Jul 06 19:45:00.941776 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.941748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" event={"ID":"3e7f605f-c064-443c-a7bb-5f2a8c459cb8","Type":"ContainerStarted","Data":"f2e2c02163481b24688d0fa94f05144e0b17e1526e056df65344d214ea6f0606"} Jul 06 19:45:00.942903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:00.942876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" event={"ID":"b7b0e74c-ca59-44a6-862c-5b4e854104c2","Type":"ContainerStarted","Data":"6b2d2f1a171f8cf7c4cea10660fe63bd789a879c51f071172b292deab6a8dd21"} Jul 06 19:45:01.949247 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:01.949148 2581 generic.go:356] "Generic (PLEG): container finished" podID="3e7f605f-c064-443c-a7bb-5f2a8c459cb8" containerID="0498414b3ff2edc31491cab3b0e1832c9f383a9609410db82d6a81e9b245a7a4" exitCode=0 Jul 06 19:45:01.949247 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:01.949233 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" event={"ID":"3e7f605f-c064-443c-a7bb-5f2a8c459cb8","Type":"ContainerDied","Data":"0498414b3ff2edc31491cab3b0e1832c9f383a9609410db82d6a81e9b245a7a4"} Jul 06 19:45:01.950740 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:01.950719 2581 generic.go:356] "Generic (PLEG): container finished" podID="b7b0e74c-ca59-44a6-862c-5b4e854104c2" containerID="2ba284a8f64d325bce1778477bedc36175790fd9028ed9e5c59f7d19f2e63e55" exitCode=0 Jul 06 19:45:01.950823 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:01.950803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" event={"ID":"b7b0e74c-ca59-44a6-862c-5b4e854104c2","Type":"ContainerDied","Data":"2ba284a8f64d325bce1778477bedc36175790fd9028ed9e5c59f7d19f2e63e55"} Jul 06 19:45:01.952372 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:01.952352 2581 generic.go:356] "Generic (PLEG): container finished" podID="30b9ef5b-8137-4a93-af57-83f3b99431e0" containerID="bbb4bc86124b8d818f0081fc6bd0f1dbd81ca744fc0dd0f0e9637165c4937125" exitCode=0 Jul 06 19:45:01.952511 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:01.952398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" event={"ID":"30b9ef5b-8137-4a93-af57-83f3b99431e0","Type":"ContainerDied","Data":"bbb4bc86124b8d818f0081fc6bd0f1dbd81ca744fc0dd0f0e9637165c4937125"} Jul 06 19:45:03.127593 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.127563 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" Jul 06 19:45:03.130879 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.130856 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" Jul 06 19:45:03.172448 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.172421 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" Jul 06 19:45:03.195992 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.195958 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg86w\" (UniqueName: \"kubernetes.io/projected/30b9ef5b-8137-4a93-af57-83f3b99431e0-kube-api-access-rg86w\") pod \"30b9ef5b-8137-4a93-af57-83f3b99431e0\" (UID: \"30b9ef5b-8137-4a93-af57-83f3b99431e0\") " Jul 06 19:45:03.195992 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.196002 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wr6f\" (UniqueName: \"kubernetes.io/projected/b7b0e74c-ca59-44a6-862c-5b4e854104c2-kube-api-access-6wr6f\") pod \"b7b0e74c-ca59-44a6-862c-5b4e854104c2\" (UID: \"b7b0e74c-ca59-44a6-862c-5b4e854104c2\") " Jul 06 19:45:03.198158 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.198126 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b0e74c-ca59-44a6-862c-5b4e854104c2-kube-api-access-6wr6f" (OuterVolumeSpecName: "kube-api-access-6wr6f") pod "b7b0e74c-ca59-44a6-862c-5b4e854104c2" (UID: "b7b0e74c-ca59-44a6-862c-5b4e854104c2"). InnerVolumeSpecName "kube-api-access-6wr6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:03.198267 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.198185 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b9ef5b-8137-4a93-af57-83f3b99431e0-kube-api-access-rg86w" (OuterVolumeSpecName: "kube-api-access-rg86w") pod "30b9ef5b-8137-4a93-af57-83f3b99431e0" (UID: "30b9ef5b-8137-4a93-af57-83f3b99431e0"). InnerVolumeSpecName "kube-api-access-rg86w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:03.297629 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.297534 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkgrg\" (UniqueName: \"kubernetes.io/projected/3e7f605f-c064-443c-a7bb-5f2a8c459cb8-kube-api-access-fkgrg\") pod \"3e7f605f-c064-443c-a7bb-5f2a8c459cb8\" (UID: \"3e7f605f-c064-443c-a7bb-5f2a8c459cb8\") " Jul 06 19:45:03.297809 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.297755 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg86w\" (UniqueName: \"kubernetes.io/projected/30b9ef5b-8137-4a93-af57-83f3b99431e0-kube-api-access-rg86w\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:45:03.297809 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.297766 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wr6f\" (UniqueName: \"kubernetes.io/projected/b7b0e74c-ca59-44a6-862c-5b4e854104c2-kube-api-access-6wr6f\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:45:03.299650 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.299621 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7f605f-c064-443c-a7bb-5f2a8c459cb8-kube-api-access-fkgrg" (OuterVolumeSpecName: "kube-api-access-fkgrg") pod "3e7f605f-c064-443c-a7bb-5f2a8c459cb8" (UID: "3e7f605f-c064-443c-a7bb-5f2a8c459cb8"). InnerVolumeSpecName "kube-api-access-fkgrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:03.398521 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.398449 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkgrg\" (UniqueName: \"kubernetes.io/projected/3e7f605f-c064-443c-a7bb-5f2a8c459cb8-kube-api-access-fkgrg\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 06 19:45:03.967443 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.967409 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" Jul 06 19:45:03.967719 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.967447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl" event={"ID":"30b9ef5b-8137-4a93-af57-83f3b99431e0","Type":"ContainerDied","Data":"12bb721a91b8ade282362cfe0e4a3d15c193ef102355e3d93815748836a17e5b"} Jul 06 19:45:03.967719 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.967519 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12bb721a91b8ade282362cfe0e4a3d15c193ef102355e3d93815748836a17e5b" Jul 06 19:45:03.968859 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.968827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" event={"ID":"3e7f605f-c064-443c-a7bb-5f2a8c459cb8","Type":"ContainerDied","Data":"f2e2c02163481b24688d0fa94f05144e0b17e1526e056df65344d214ea6f0606"} Jul 06 19:45:03.968982 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.968875 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2e2c02163481b24688d0fa94f05144e0b17e1526e056df65344d214ea6f0606" Jul 06 19:45:03.968982 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.968838 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59" Jul 06 19:45:03.970116 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.970098 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" Jul 06 19:45:03.970224 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.970117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-n65rf" event={"ID":"b7b0e74c-ca59-44a6-862c-5b4e854104c2","Type":"ContainerDied","Data":"6b2d2f1a171f8cf7c4cea10660fe63bd789a879c51f071172b292deab6a8dd21"} Jul 06 19:45:03.970224 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:03.970163 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b2d2f1a171f8cf7c4cea10660fe63bd789a879c51f071172b292deab6a8dd21" Jul 06 19:45:09.573473 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:45:09.573441 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:46:15.433926 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:46:15.433879 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:46:16.690615 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:46:16.690581 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:47:08.672617 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:47:08.672583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:47:09.528984 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:47:09.528943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:47:47.108417 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:47:47.108375 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:48:04.487734 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:48:04.487698 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:48:17.907101 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:48:17.907066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:48:18.022390 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:48:18.022357 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:48:54.516292 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:48:54.516262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:48:55.484707 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:48:55.484672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:48:57.850223 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:48:57.850184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:49:04.737947 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:04.737914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:49:15.232621 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:15.232582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:49:31.155269 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:31.155234 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:49:51.504119 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:51.504086 2581 generic.go:356] "Generic (PLEG): container finished" podID="36df7164-2c26-4385-829b-ad23c382f938" containerID="8b40504821e4020c99ffe0ef7dfb9c60c9668b49f2812e094d8050f82ff3743f" exitCode=1 Jul 06 19:49:51.504566 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:51.504164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" event={"ID":"36df7164-2c26-4385-829b-ad23c382f938","Type":"ContainerDied","Data":"8b40504821e4020c99ffe0ef7dfb9c60c9668b49f2812e094d8050f82ff3743f"} Jul 06 19:49:51.504566 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:51.504555 2581 scope.go:117] "RemoveContainer" containerID="8b40504821e4020c99ffe0ef7dfb9c60c9668b49f2812e094d8050f82ff3743f" Jul 06 19:49:51.951430 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:51.951316 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:49:52.230370 ip-10-0-142-233 kubenswrapper[2581]: E0706 19:49:52.230319 2581 controller.go:195] "Failed to update lease" err="Put \"https://a222d379bd82d4b8d94201e0815a06f4-c29cc58d05ce0064.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-233.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 06 19:49:52.512157 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:52.512066 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" event={"ID":"36df7164-2c26-4385-829b-ad23c382f938","Type":"ContainerStarted","Data":"1a354ba29375475392965e7cad416878de9339524798eb4c5f29a99951cf346a"} Jul 06 19:49:52.512545 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:49:52.512201 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:50:01.475164 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:01.475134 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:50:03.520148 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:03.520116 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-689b9cdffd-96827" Jul 06 19:50:20.804987 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:20.804948 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:50:35.044743 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:35.044709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:50:35.158575 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:35.158539 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:50:48.157750 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:48.157708 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl"] Jul 06 19:50:48.161752 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:48.161728 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-f22821-29722785-qx4pl"] Jul 06 19:50:48.717925 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:48.717887 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b9ef5b-8137-4a93-af57-83f3b99431e0" path="/var/lib/kubelet/pods/30b9ef5b-8137-4a93-af57-83f3b99431e0/volumes" Jul 06 19:50:48.887802 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:48.887763 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:50:49.000301 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:49.000182 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:50:49.114777 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:49.114736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:50:54.135974 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:50:54.135913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:24.887265 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:24.887229 2581 scope.go:117] "RemoveContainer" containerID="bbb4bc86124b8d818f0081fc6bd0f1dbd81ca744fc0dd0f0e9637165c4937125" Jul 06 19:51:33.044715 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:33.044681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:34.573230 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:34.573197 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:42.608203 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:42.608163 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:42.734282 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:42.734248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:43.083084 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:43.083050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:43.341259 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:43.341171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:43.680408 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:43.680323 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:44.099541 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:44.099509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:44.727091 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:44.727045 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:51:44.777655 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:44.777614 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59"] Jul 06 19:51:44.779839 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:44.779804 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-9293de-29722785-n6z59"] Jul 06 19:51:46.717039 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:46.716935 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e7f605f-c064-443c-a7bb-5f2a8c459cb8" path="/var/lib/kubelet/pods/3e7f605f-c064-443c-a7bb-5f2a8c459cb8/volumes" Jul 06 19:51:49.266827 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:51:49.266777 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:52:24.908318 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:24.908285 2581 scope.go:117] "RemoveContainer" containerID="0498414b3ff2edc31491cab3b0e1832c9f383a9609410db82d6a81e9b245a7a4" Jul 06 19:52:26.161155 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:26.161104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:52:28.623787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:28.623746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:52:35.652788 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:35.652745 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:52:35.781943 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:35.781367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:52:35.973287 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:35.973238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:52:36.207971 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:36.207943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:52:42.326918 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:42.326882 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d7888c7bf-mkdh5_9209b655-255d-4570-9793-fd332604738b/maas-api/0.log" Jul 06 19:52:42.440385 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:42.440348 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722770-sjvqd_65e73220-c8d4-44fa-80f1-5c17a5f9c1f6/cleanup/0.log" Jul 06 19:52:42.553603 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:42.553577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-n65rf_b7b0e74c-ca59-44a6-862c-5b4e854104c2/cleanup/0.log" Jul 06 19:52:43.320374 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:43.320339 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b48f9c585-cp96s_ea5318ce-7909-4c95-8c9a-315f25cc7f52/copy-manifests/0.log" Jul 06 19:52:43.329311 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:43.329277 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b48f9c585-cp96s_ea5318ce-7909-4c95-8c9a-315f25cc7f52/manager/0.log" Jul 06 19:52:43.443884 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:43.443853 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ntd2r_7dba16af-9006-4400-bd0c-e3d7ad434456/postgres/0.log" Jul 06 19:52:46.367013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:46.366981 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sqlv2_1a8fae48-9541-4306-82d0-a582b89e4f43/discovery/0.log" Jul 06 19:52:46.857725 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:46.857698 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-mzcxk_13b5228a-555f-47a1-aa9a-758836669b42/payload-pre-processing/0.log" Jul 06 19:52:47.330274 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:47.330237 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wdmgr_7592f7e3-3eb7-4ff8-9c21-fa87091a8225/payload-processing/0.log" Jul 06 19:52:47.947207 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:47.947168 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-t6phm_fd5de704-e5f1-46d6-b3e8-1b44c6406e2b/main/0.log" Jul 06 19:52:48.073629 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:48.073602 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-z9fxv_a980d898-105c-46a4-9acf-a2aced7cf36a/main/0.log" Jul 06 19:52:53.147387 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:53.147354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:52:53.244155 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:52:53.244116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" limit=1024 Jul 06 19:53:20.543239 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:53:20.543202 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hfdw8_8426f194-af92-433c-b71d-50b6d56fcd23/global-pull-secret-syncer/0.log" Jul 06 19:53:20.608304 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:53:20.608273 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2g65w_219aa01a-8349-48e1-a36c-d05e3c5ea7a8/konnectivity-agent/0.log" Jul 06 19:53:24.131036 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:53:24.131002 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-233.ec2.internal_61e1c42ac9a08ecfb3c8cc5e93139196/haproxy/0.log" Jul 06 19:54:26.765946 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.765915 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv"] Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766320 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b9ef5b-8137-4a93-af57-83f3b99431e0" containerName="cleanup" Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766331 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b9ef5b-8137-4a93-af57-83f3b99431e0" containerName="cleanup" Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766350 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b0e74c-ca59-44a6-862c-5b4e854104c2" containerName="cleanup" Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766356 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b0e74c-ca59-44a6-862c-5b4e854104c2" containerName="cleanup" Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766363 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e7f605f-c064-443c-a7bb-5f2a8c459cb8" containerName="cleanup" Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766369 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e7f605f-c064-443c-a7bb-5f2a8c459cb8" containerName="cleanup" Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766433 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b9ef5b-8137-4a93-af57-83f3b99431e0" containerName="cleanup" Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766441 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e7f605f-c064-443c-a7bb-5f2a8c459cb8" containerName="cleanup" Jul 06 19:54:26.766492 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.766447 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b0e74c-ca59-44a6-862c-5b4e854104c2" containerName="cleanup" Jul 06 19:54:26.770669 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.770649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.776285 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.776263 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mrhbq\"/\"kube-root-ca.crt\"" Jul 06 19:54:26.776853 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.776835 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mrhbq\"/\"default-dockercfg-8w4wr\"" Jul 06 19:54:26.778888 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.778868 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mrhbq\"/\"openshift-service-ca.crt\"" Jul 06 19:54:26.843818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.843783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-podres\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.844046 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.843840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-sys\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.844046 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.843945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-proc\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.844046 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.843991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zvns\" (UniqueName: \"kubernetes.io/projected/1c18dc66-fede-4794-bf8b-d6193e65eb60-kube-api-access-6zvns\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.844046 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.844031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-lib-modules\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.944621 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.944583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-proc\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.944621 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.944624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zvns\" (UniqueName: \"kubernetes.io/projected/1c18dc66-fede-4794-bf8b-d6193e65eb60-kube-api-access-6zvns\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.944903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.944650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-lib-modules\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.944903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.944722 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-proc\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.944903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.944772 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-lib-modules\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.944903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.944822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-podres\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.944903 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.944899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-sys\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.945118 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.944936 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-podres\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.945118 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.945013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c18dc66-fede-4794-bf8b-d6193e65eb60-sys\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:26.950715 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:26.950685 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv"] Jul 06 19:54:27.033974 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:27.033883 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zvns\" (UniqueName: \"kubernetes.io/projected/1c18dc66-fede-4794-bf8b-d6193e65eb60-kube-api-access-6zvns\") pod \"perf-node-gather-daemonset-jqpdv\" (UID: \"1c18dc66-fede-4794-bf8b-d6193e65eb60\") " pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:27.081898 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:27.081868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:27.460618 ip-10-0-142-233 kubenswrapper[2581]: W0706 19:54:27.460587 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c18dc66_fede_4794_bf8b_d6193e65eb60.slice/crio-d5c8f44e3166a2c3a67ffad447af691c70c820ef43bc567e4502c0db6c232cb5 WatchSource:0}: Error finding container d5c8f44e3166a2c3a67ffad447af691c70c820ef43bc567e4502c0db6c232cb5: Status 404 returned error can't find the container with id d5c8f44e3166a2c3a67ffad447af691c70c820ef43bc567e4502c0db6c232cb5 Jul 06 19:54:27.468064 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:27.468043 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv"] Jul 06 19:54:27.977809 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:27.977772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" event={"ID":"1c18dc66-fede-4794-bf8b-d6193e65eb60","Type":"ContainerStarted","Data":"f053113983e2613b0d24d4290f1e3531652e2594b4b2a4d4caab07ca9954bc6b"} Jul 06 19:54:27.978303 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:27.977831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" event={"ID":"1c18dc66-fede-4794-bf8b-d6193e65eb60","Type":"ContainerStarted","Data":"d5c8f44e3166a2c3a67ffad447af691c70c820ef43bc567e4502c0db6c232cb5"} Jul 06 19:54:27.978303 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:27.977887 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:28.025680 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:28.025611 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" podStartSLOduration=6.025595673 podStartE2EDuration="6.025595673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:28.024199959 +0000 UTC m=+2944.113524116" watchObservedRunningTime="2026-07-06 19:54:28.025595673 +0000 UTC m=+2944.114919875" Jul 06 19:54:32.253329 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:32.253301 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1fc97140-3291-4bd7-b2ad-893af0b111a8/alertmanager/0.log" Jul 06 19:54:32.357807 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:32.357770 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1fc97140-3291-4bd7-b2ad-893af0b111a8/config-reloader/0.log" Jul 06 19:54:32.423025 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:32.422989 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1fc97140-3291-4bd7-b2ad-893af0b111a8/kube-rbac-proxy-web/0.log" Jul 06 19:54:32.521911 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:32.521804 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1fc97140-3291-4bd7-b2ad-893af0b111a8/kube-rbac-proxy/0.log" Jul 06 19:54:32.630676 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:32.630649 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1fc97140-3291-4bd7-b2ad-893af0b111a8/kube-rbac-proxy-metric/0.log" Jul 06 19:54:32.698037 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:32.698008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1fc97140-3291-4bd7-b2ad-893af0b111a8/prom-label-proxy/0.log" Jul 06 19:54:32.765156 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:32.765109 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1fc97140-3291-4bd7-b2ad-893af0b111a8/init-config-reloader/0.log" Jul 06 19:54:32.827400 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:32.827308 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-dld48_9c6ca05c-aed5-44af-8ddb-2050967e3d20/cluster-monitoring-operator/0.log" Jul 06 19:54:33.051557 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.051514 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c988ddcc4-jcvbx_728151cc-42cf-4579-b6e0-b01ce8a3a938/metrics-server/0.log" Jul 06 19:54:33.174861 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.174781 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6p46m_6cbb8272-31db-4f4e-9f8e-f579172db7ff/node-exporter/0.log" Jul 06 19:54:33.231920 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.231883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6p46m_6cbb8272-31db-4f4e-9f8e-f579172db7ff/kube-rbac-proxy/0.log" Jul 06 19:54:33.281269 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.281244 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6p46m_6cbb8272-31db-4f4e-9f8e-f579172db7ff/init-textfile/0.log" Jul 06 19:54:33.599013 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.598983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-k72qx_0e1b1892-97b6-46ac-8dc2-156f22319395/kube-rbac-proxy-main/0.log" Jul 06 19:54:33.635240 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.635182 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-k72qx_0e1b1892-97b6-46ac-8dc2-156f22319395/kube-rbac-proxy-self/0.log" Jul 06 19:54:33.691405 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.691375 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-k72qx_0e1b1892-97b6-46ac-8dc2-156f22319395/openshift-state-metrics/0.log" Jul 06 19:54:33.737953 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.737903 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a74d9551-ac48-4001-850d-875a7f90ebe1/prometheus/0.log" Jul 06 19:54:33.793892 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.793866 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a74d9551-ac48-4001-850d-875a7f90ebe1/config-reloader/0.log" Jul 06 19:54:33.830577 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.830551 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a74d9551-ac48-4001-850d-875a7f90ebe1/thanos-sidecar/0.log" Jul 06 19:54:33.862041 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.861966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a74d9551-ac48-4001-850d-875a7f90ebe1/kube-rbac-proxy-web/0.log" Jul 06 19:54:33.902973 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.902949 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a74d9551-ac48-4001-850d-875a7f90ebe1/kube-rbac-proxy/0.log" Jul 06 19:54:33.964546 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.964517 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a74d9551-ac48-4001-850d-875a7f90ebe1/kube-rbac-proxy-thanos/0.log" Jul 06 19:54:33.993134 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:33.993107 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mrhbq/perf-node-gather-daemonset-jqpdv" Jul 06 19:54:34.014738 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:34.014710 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a74d9551-ac48-4001-850d-875a7f90ebe1/init-config-reloader/0.log" Jul 06 19:54:34.848818 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:34.848792 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-4hj46_9b88e2eb-480a-42c9-8aba-8a8c7fb7456c/prometheus-operator-admission-webhook/0.log" Jul 06 19:54:34.943306 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:34.943275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84bdf58886-wv4f8_645910f4-537f-44c8-9d92-5c9042657ffa/telemeter-client/0.log" Jul 06 19:54:35.005593 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:35.005564 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84bdf58886-wv4f8_645910f4-537f-44c8-9d92-5c9042657ffa/reload/0.log" Jul 06 19:54:35.134050 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:35.133975 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84bdf58886-wv4f8_645910f4-537f-44c8-9d92-5c9042657ffa/kube-rbac-proxy/0.log" Jul 06 19:54:35.178242 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:35.178215 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cf4594746-qwhvg_64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73/thanos-query/0.log" Jul 06 19:54:35.231914 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:35.231884 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cf4594746-qwhvg_64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73/kube-rbac-proxy-web/0.log" Jul 06 19:54:35.268880 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:35.268854 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cf4594746-qwhvg_64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73/kube-rbac-proxy/0.log" Jul 06 19:54:35.313860 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:35.313831 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cf4594746-qwhvg_64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73/prom-label-proxy/0.log" Jul 06 19:54:35.373858 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:35.373827 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cf4594746-qwhvg_64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73/kube-rbac-proxy-rules/0.log" Jul 06 19:54:35.419769 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:35.419674 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cf4594746-qwhvg_64fbca87-ef1f-4d1f-ba9f-9fa67ec6bf73/kube-rbac-proxy-metrics/0.log" Jul 06 19:54:36.744398 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:36.744369 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-d8728_0e714f25-7037-4a04-89a5-aa1cefa14504/networking-console-plugin/0.log" Jul 06 19:54:38.417977 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:38.417941 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sqlv2_1a8fae48-9541-4306-82d0-a582b89e4f43/discovery/0.log" Jul 06 19:54:38.726877 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:38.726848 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-mzcxk_13b5228a-555f-47a1-aa9a-758836669b42/payload-pre-processing/0.log" Jul 06 19:54:38.792073 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:38.792035 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wdmgr_7592f7e3-3eb7-4ff8-9c21-fa87091a8225/payload-processing/0.log" Jul 06 19:54:39.740886 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:39.740843 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-z4xtm_975c0e3a-dcea-44ba-b27e-d924b05a8338/volume-data-source-validator/0.log" Jul 06 19:54:40.475582 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:40.475543 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sqlv2_1a8fae48-9541-4306-82d0-a582b89e4f43/discovery/0.log" Jul 06 19:54:40.757025 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:40.756972 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-mzcxk_13b5228a-555f-47a1-aa9a-758836669b42/payload-pre-processing/0.log" Jul 06 19:54:40.824141 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:40.824099 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wdmgr_7592f7e3-3eb7-4ff8-9c21-fa87091a8225/payload-processing/0.log" Jul 06 19:54:41.414897 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:41.414868 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgf9z_33b13a8a-5a99-4d9c-ac94-512a42898c15/dns/0.log" Jul 06 19:54:41.485586 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:41.485554 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgf9z_33b13a8a-5a99-4d9c-ac94-512a42898c15/kube-rbac-proxy/0.log" Jul 06 19:54:42.009944 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:42.009916 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h5kp8_5f137841-b4b0-4311-9473-a155a6f320fe/dns-node-resolver/0.log" Jul 06 19:54:42.863326 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:42.863288 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5z2tp_5efa33d4-4aab-46fb-a9e1-687e3d4b07ef/node-ca/0.log" Jul 06 19:54:44.232181 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:44.232147 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sqlv2_1a8fae48-9541-4306-82d0-a582b89e4f43/discovery/0.log" Jul 06 19:54:44.516921 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:44.516838 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-mzcxk_13b5228a-555f-47a1-aa9a-758836669b42/payload-pre-processing/0.log" Jul 06 19:54:44.590232 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:44.590188 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wdmgr_7592f7e3-3eb7-4ff8-9c21-fa87091a8225/payload-processing/0.log" Jul 06 19:54:45.508285 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:45.508204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nbhrc_05cabb41-49be-452e-b240-1447ec5b47bf/serve-healthcheck-canary/0.log" Jul 06 19:54:46.152787 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:46.152698 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rb7xt_fc5fdac8-1e13-4482-8396-39419138335a/insights-operator/0.log" Jul 06 19:54:46.153011 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:46.152991 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rb7xt_fc5fdac8-1e13-4482-8396-39419138335a/insights-operator/1.log" Jul 06 19:54:46.199037 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:46.199011 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5v4pd_b2847708-9fe0-46d1-bd4e-a220ecf19e4b/kube-rbac-proxy/0.log" Jul 06 19:54:46.245264 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:46.245232 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5v4pd_b2847708-9fe0-46d1-bd4e-a220ecf19e4b/exporter/0.log" Jul 06 19:54:46.289909 ip-10-0-142-233 kubenswrapper[2581]: I0706 19:54:46.289876 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5v4pd_b2847708-9fe0-46d1-bd4e-a220ecf19e4b/extractor/0.log"