Jul 13 23:37:23.445943 ip-10-0-136-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 23:37:23.445969 ip-10-0-136-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 23:37:23.445978 ip-10-0-136-62 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 23:37:23.446261 ip-10-0-136-62 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 23:37:33.527052 ip-10-0-136-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 23:37:33.527068 ip-10-0-136-62 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b6f5373c1417463692bac2710abad507 -- Jul 13 23:39:25.731481 ip-10-0-136-62 systemd[1]: Starting Kubernetes Kubelet... Jul 13 23:39:26.087213 ip-10-0-136-62 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 23:39:26.087213 ip-10-0-136-62 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 23:39:26.087213 ip-10-0-136-62 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 23:39:26.087213 ip-10-0-136-62 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 23:39:26.087213 ip-10-0-136-62 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 23:39:26.088931 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.088815 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 23:39:26.093072 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093057 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 23:39:26.093072 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093072 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093077 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093080 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093084 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093087 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093089 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093098 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093100 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093103 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093106 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093108 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093111 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093114 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093117 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093119 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093124 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093127 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093130 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093133 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 23:39:26.093131 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093136 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093139 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093142 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093145 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093148 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093150 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093153 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093156 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093158 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093161 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093163 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093166 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093168 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093171 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093173 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093176 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093178 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093181 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093183 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093186 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 23:39:26.093642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093188 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093191 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093194 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093211 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093216 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093219 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093221 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093225 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093227 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093230 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093234 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093237 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093240 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093244 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093247 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093250 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093253 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093255 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093258 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093261 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 23:39:26.094370 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093264 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093267 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093269 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093272 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093274 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093277 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093279 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093282 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093285 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093287 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093290 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093292 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093294 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093298 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093302 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093306 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093308 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093311 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093313 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 23:39:26.094850 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093315 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093318 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093320 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093323 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093325 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093328 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093332 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093335 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093338 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093340 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093343 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093346 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093348 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093351 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093354 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093356 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093358 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093361 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093364 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 23:39:26.095306 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.093366 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 23:39:26.096229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096213 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 23:39:26.096229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096228 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096232 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096236 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096239 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096242 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096245 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096248 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096251 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096254 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096260 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096263 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096266 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096269 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096271 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096274 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096277 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096280 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096282 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096285 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096288 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 23:39:26.096287 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096291 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096294 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096299 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096302 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096305 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096308 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096313 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096316 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096319 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096322 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096325 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096328 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096331 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096334 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096339 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096342 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096344 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096347 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096350 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 23:39:26.096804 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096352 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096355 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096358 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096360 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096363 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096367 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096370 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096375 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096377 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096380 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096383 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096386 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096388 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096391 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096396 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096399 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096402 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096405 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096408 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096413 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 23:39:26.097266 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096416 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096419 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096422 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096424 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096427 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096430 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096433 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096435 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096438 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096440 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096443 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096445 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096451 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096453 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096456 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096458 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096463 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096465 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096468 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096471 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 23:39:26.097749 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096474 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096476 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096479 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096483 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096489 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096493 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096499 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096503 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096506 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096509 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096513 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096516 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096518 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096522 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096526 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096529 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096534 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096536 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.096539 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 23:39:26.098229 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097218 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097225 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097228 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097231 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097234 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097237 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097243 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097246 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097249 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097252 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097255 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097258 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097261 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097264 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097267 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097271 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097274 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097277 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097282 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 23:39:26.098693 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097286 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097290 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097293 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097295 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097298 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097301 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097304 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097308 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097311 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097314 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097317 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097320 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097325 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097329 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097333 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097336 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097339 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097342 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097346 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 23:39:26.099155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097349 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097352 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097355 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097358 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097361 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097366 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097369 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097372 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097375 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097378 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097380 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097383 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097386 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097389 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097392 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097395 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097397 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097403 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097405 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097408 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 23:39:26.099617 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097411 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097414 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097417 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097420 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097423 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097425 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097428 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097431 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097433 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097439 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097442 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097445 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097448 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097450 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097453 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097455 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097458 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097461 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097464 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097468 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 23:39:26.100116 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097471 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097476 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097479 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097481 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097485 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097488 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097491 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097494 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097497 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097499 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097502 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097505 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097507 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097510 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097515 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097518 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097521 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097523 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097526 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097528 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 23:39:26.100614 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.097531 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097803 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097817 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097825 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097829 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097833 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097837 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097842 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097845 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097849 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097852 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097855 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097859 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097862 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097865 2557 flags.go:64] FLAG: --cgroup-root="" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097868 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097871 2557 flags.go:64] FLAG: --client-ca-file="" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097874 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097877 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097882 2557 flags.go:64] FLAG: --cluster-domain="" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097884 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097887 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097890 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097896 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 23:39:26.101083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097900 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097904 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097907 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097913 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097916 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097920 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097923 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097928 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097930 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097936 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097940 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097943 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097946 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097949 2557 flags.go:64] FLAG: --enable-server="true" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097953 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097957 2557 flags.go:64] FLAG: --event-burst="100" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097960 2557 flags.go:64] FLAG: --event-qps="50" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097963 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097967 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097969 2557 flags.go:64] FLAG: --eviction-hard="" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097973 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097976 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097979 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097982 2557 flags.go:64] FLAG: --eviction-soft="" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097985 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 23:39:26.101685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097988 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097990 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097993 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097996 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.097999 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098001 2557 flags.go:64] FLAG: --feature-gates="" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098005 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098008 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098011 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098014 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098017 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098020 2557 flags.go:64] FLAG: --help="false" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098023 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-136-62.ec2.internal" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098026 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098029 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098031 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098035 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098039 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098042 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098046 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098048 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098051 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098054 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098057 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 23:39:26.102315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098060 2557 flags.go:64] FLAG: --kube-reserved="" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098063 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098066 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098069 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098071 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098074 2557 flags.go:64] FLAG: --lock-file="" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098077 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098079 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098082 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098087 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098090 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098093 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098096 2557 flags.go:64] FLAG: --logging-format="text" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098099 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098102 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098105 2557 flags.go:64] FLAG: --manifest-url="" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098108 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098112 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098115 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098119 2557 flags.go:64] FLAG: --max-pods="110" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098122 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098125 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098128 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098131 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098134 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 23:39:26.102892 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098137 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098140 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098148 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098151 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098154 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098157 2557 flags.go:64] FLAG: --pod-cidr="" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098160 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098166 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098169 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098172 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098175 2557 flags.go:64] FLAG: --port="10250" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098178 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098181 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0db04702c16a9a410" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098184 2557 flags.go:64] FLAG: --qos-reserved="" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098187 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098190 2557 flags.go:64] FLAG: --register-node="true" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098193 2557 flags.go:64] FLAG: --register-with-taints="" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098196 2557 flags.go:64] FLAG: --registry-burst="10" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098216 2557 flags.go:64] FLAG: --registry-qps="5" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098219 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098222 2557 flags.go:64] FLAG: --reserved-memory="" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098226 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098229 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098232 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098235 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 23:39:26.103501 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098239 2557 flags.go:64] FLAG: --runonce="false" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098242 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098245 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098248 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098251 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098254 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098260 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098263 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098266 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098269 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098272 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098275 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098278 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098281 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098284 2557 flags.go:64] FLAG: --system-cgroups="" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098287 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098293 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098295 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098298 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098302 2557 flags.go:64] FLAG: --tls-min-version="" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098305 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098308 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098311 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098314 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098317 2557 flags.go:64] FLAG: --v="2" Jul 13 23:39:26.104091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098320 2557 flags.go:64] FLAG: --version="false" Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098325 2557 flags.go:64] FLAG: --vmodule="" Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098328 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.098332 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098451 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098455 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098459 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098462 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098466 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098470 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098474 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098477 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098481 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098485 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098487 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098491 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098494 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098496 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098499 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 23:39:26.104745 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098503 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098507 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098510 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098512 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098515 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098517 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098520 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098522 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098525 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098527 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098530 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098532 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098535 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098537 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098539 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098543 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098545 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098548 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098550 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098553 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 23:39:26.105236 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098555 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098558 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098561 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098563 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098566 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098568 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098572 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098575 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098578 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098580 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098583 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098585 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098588 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098590 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098593 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098595 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098598 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098601 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098603 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098606 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 23:39:26.105705 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098609 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098611 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098613 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098617 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098621 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098624 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098627 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098630 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098633 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098636 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098639 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098641 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098644 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098647 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098649 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098652 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098655 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098657 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098661 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098663 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 23:39:26.106184 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098666 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098669 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098671 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098674 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098676 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098679 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098681 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098684 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098686 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098689 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098691 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098694 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098696 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098699 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098701 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098704 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098708 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098710 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098713 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 23:39:26.106672 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098715 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098718 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098721 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098723 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.098726 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.099391 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.106186 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.106217 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.106238 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.106243 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106301 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106306 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106310 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106313 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 23:39:26.107134 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106316 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106319 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106322 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106325 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106327 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106330 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106332 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106335 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106337 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106340 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106343 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106345 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106347 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106350 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106352 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106355 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106358 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106360 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106363 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 23:39:26.107484 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106365 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106369 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106373 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106376 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106379 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106382 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106386 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106389 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106392 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106394 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106398 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106400 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106403 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106406 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106409 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106411 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106414 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106417 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106419 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 23:39:26.107929 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106422 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106425 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106427 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106430 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106432 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106435 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106438 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106440 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106443 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106446 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106448 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106450 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106453 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106455 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106458 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106460 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106463 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106466 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106469 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106472 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 23:39:26.108379 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106476 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106478 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106481 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106484 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106486 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106489 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106492 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106494 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106498 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106501 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106504 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106507 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106509 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106512 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106514 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106517 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106520 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106522 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106524 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106527 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 23:39:26.108864 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106530 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106532 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106535 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106537 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106540 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106542 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106545 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106548 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106550 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106554 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106557 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106561 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106564 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106568 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106571 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106573 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 23:39:26.109421 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106576 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.106581 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106706 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106711 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106714 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106717 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106719 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106723 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106725 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106728 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106731 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106733 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106736 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106739 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106741 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 23:39:26.109792 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106744 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106746 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106749 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106751 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106754 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106756 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106759 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106761 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106763 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106766 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106768 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106771 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106773 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106776 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106779 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106782 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106784 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106787 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106789 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106792 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 23:39:26.110155 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106795 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106797 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106799 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106802 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106805 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106807 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106809 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106812 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106814 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106818 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106821 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106824 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106827 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106830 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106833 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106835 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106838 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106840 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 23:39:26.110642 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106844 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106847 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106850 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106852 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106855 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106858 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106861 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106864 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106866 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106869 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106872 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106875 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106878 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106880 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106883 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106886 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106889 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106892 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106894 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106896 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 23:39:26.111056 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106899 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106901 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106904 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106906 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106908 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106911 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106913 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106916 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106918 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106921 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106923 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106925 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106928 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106931 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106933 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106935 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106938 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106941 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106944 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106947 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 23:39:26.111540 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106949 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106952 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106954 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106958 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106960 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106963 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106965 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:26.106968 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.106973 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.107074 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.110156 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.111688 2557 server.go:1019] "Starting client certificate rotation" Jul 13 23:39:26.111995 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.111792 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 23:39:26.112465 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.112448 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 23:39:26.114421 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.114406 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 23:39:26.116217 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.116177 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 23:39:26.125868 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.125832 2557 log.go:25] "Validated CRI v1 runtime API" Jul 13 23:39:26.129962 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.129944 2557 log.go:25] "Validated CRI v1 image API" Jul 13 23:39:26.130836 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.130821 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 23:39:26.133163 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.133140 2557 fs.go:135] Filesystem UUIDs: map[30cc0a1f-8936-4db9-9a12-5129a4aed7c2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c3b69118-9f4d-454f-9097-50bdf4783166:/dev/nvme0n1p4] Jul 13 23:39:26.133253 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.133161 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 23:39:26.138985 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.138873 2557 manager.go:216] Machine: {Timestamp:2026-07-13 23:39:26.136755818 +0000 UTC m=+0.301071308 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106484 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eda276a5a5724c9f1393198500063 SystemUUID:ec2eda27-6a5a-5724-c9f1-393198500063 BootID:b6f5373c-1417-4636-92ba-c2710abad507 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:ec:00:aa:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:ec:00:aa:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:93:a6:69:f8:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 23:39:26.138985 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.138974 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 23:39:26.139125 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.139078 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 23:39:26.140728 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.140711 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 23:39:26.141804 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.141773 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 23:39:26.141992 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.141811 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 23:39:26.142635 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.142622 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 23:39:26.142686 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.142641 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 23:39:26.142686 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.142653 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 23:39:26.142686 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.142673 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 23:39:26.143820 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.143807 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 23:39:26.147143 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147129 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 13 23:39:26.147289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147279 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 23:39:26.147346 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147316 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 13 23:39:26.147346 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147330 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 23:39:26.147431 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147349 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 23:39:26.147431 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147363 2557 kubelet.go:398] "Adding apiserver pod source" Jul 13 23:39:26.147431 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147378 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 23:39:26.147748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147734 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 23:39:26.147807 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.147757 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 23:39:26.149949 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.149925 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 23:39:26.152005 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.151992 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 23:39:26.152051 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152023 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 23:39:26.152754 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152742 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 23:39:26.152787 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152763 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 23:39:26.152787 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152773 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 23:39:26.152787 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152780 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 23:39:26.152864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152794 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 23:39:26.152864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152800 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 23:39:26.152864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152808 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 23:39:26.152864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152813 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 23:39:26.152864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152819 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 23:39:26.152864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152824 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 23:39:26.152864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152836 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 23:39:26.152864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.152841 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 23:39:26.153620 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.153607 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 23:39:26.153620 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.153618 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 23:39:26.156766 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.156753 2557 server.go:1268] "Started kubelet" Jul 13 23:39:26.157099 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.157069 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 23:39:26.157628 ip-10-0-136-62 systemd[1]: Started Kubernetes Kubelet. Jul 13 23:39:26.157827 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.157610 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 23:39:26.157957 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.157938 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 23:39:26.159293 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.159265 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 23:39:26.159398 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.159363 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 23:39:26.159465 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.159398 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 23:39:26.159505 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.159434 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 23:39:26.159536 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.159510 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 13 23:39:26.162832 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.162812 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 23:39:26.163546 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.163514 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zqbmh" Jul 13 23:39:26.166412 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.165561 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-62.ec2.internal.18c1fdc8c50dc23c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-62.ec2.internal,UID:ip-10-0-136-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-62.ec2.internal,},FirstTimestamp:2026-07-13 23:39:26.156726844 +0000 UTC m=+0.321042335,LastTimestamp:2026-07-13 23:39:26.156726844 +0000 UTC m=+0.321042335,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-62.ec2.internal,}" Jul 13 23:39:26.167163 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.167143 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 23:39:26.167163 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.167156 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 23:39:26.167850 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.167827 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:26.167949 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.167885 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 23:39:26.167949 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.167919 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 23:39:26.168067 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.167958 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 23:39:26.168105 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168095 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 13 23:39:26.168142 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168105 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 13 23:39:26.168185 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168145 2557 factory.go:55] Registering systemd factory Jul 13 23:39:26.168185 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168161 2557 factory.go:223] Registration of the systemd container factory successfully Jul 13 23:39:26.168431 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168415 2557 factory.go:153] Registering CRI-O factory Jul 13 23:39:26.168431 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168432 2557 factory.go:223] Registration of the crio container factory successfully Jul 13 23:39:26.168571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168482 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 23:39:26.168571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168504 2557 factory.go:103] Registering Raw factory Jul 13 23:39:26.168571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168517 2557 manager.go:1196] Started watching for new ooms in manager Jul 13 23:39:26.168906 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.168893 2557 manager.go:349] Starting recovery of all containers Jul 13 23:39:26.171340 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.171319 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zqbmh" Jul 13 23:39:26.172105 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.172078 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 23:39:26.172813 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.172790 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 23:39:26.175433 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.175394 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 23:39:26.178099 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.178076 2557 manager.go:354] Recovery completed Jul 13 23:39:26.183414 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.183318 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 23:39:26.185521 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.185506 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jul 13 23:39:26.185602 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.185536 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 23:39:26.185602 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.185550 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jul 13 23:39:26.186038 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.186015 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 23:39:26.186038 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.186033 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 23:39:26.186150 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.186046 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 23:39:26.186150 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.186051 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 13 23:39:26.186696 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.186683 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jul 13 23:39:26.186736 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.186713 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 23:39:26.186736 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.186728 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jul 13 23:39:26.187180 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.187169 2557 policy_none.go:49] "None policy: Start" Jul 13 23:39:26.187229 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.187185 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 23:39:26.187229 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.187194 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 23:39:26.187885 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.187826 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-62.ec2.internal.18c1fdc8c6c519f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-62.ec2.internal,UID:ip-10-0-136-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-62.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-62.ec2.internal,},FirstTimestamp:2026-07-13 23:39:26.185519609 +0000 UTC m=+0.349835105,LastTimestamp:2026-07-13 23:39:26.185519609 +0000 UTC m=+0.349835105,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-62.ec2.internal,}" Jul 13 23:39:26.188431 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.188419 2557 policy_none.go:47] "Start" Jul 13 23:39:26.224712 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.224698 2557 manager.go:337] "Starting Device Plugin manager" Jul 13 23:39:26.224770 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.224728 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 23:39:26.224770 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.224739 2557 server.go:87] "Starting device plugin registration server" Jul 13 23:39:26.225009 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.224997 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 23:39:26.225081 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.225010 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 23:39:26.225081 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.225076 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 23:39:26.225179 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.225156 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 23:39:26.225179 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.225165 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 23:39:26.225587 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.225567 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 23:39:26.225672 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.225611 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:26.312759 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.312735 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 23:39:26.313833 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.312774 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 23:39:26.313833 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.312795 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 23:39:26.313833 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.312825 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 23:39:26.314948 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.314933 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 23:39:26.325438 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.325424 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 23:39:26.326787 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.326773 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jul 13 23:39:26.326834 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.326803 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 23:39:26.326834 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.326814 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jul 13 23:39:26.326899 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.326839 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-62.ec2.internal" Jul 13 23:39:26.334699 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.334685 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-62.ec2.internal" Jul 13 23:39:26.334744 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.334706 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-62.ec2.internal\": node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:26.349069 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:26.349013 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:26.413281 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.413250 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal"] Jul 13 23:39:26.413414 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.413340 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 23:39:26.414353 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.414339 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jul 13 23:39:26.414418 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.414367 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 23:39:26.414418 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.414376 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jul 13 23:39:26.415685 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.415671 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 23:39:26.415801 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.415783 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:26.415837 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.415817 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 23:39:26.416428 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.416410 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jul 13 23:39:26.416428 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.416425 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jul 13 23:39:26.416556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.416441 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 23:39:26.416556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.416443 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 23:39:26.416556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.416456 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jul 13 23:39:26.416556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.416480 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jul 13 23:39:26.417739 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.417723 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jul 13 23:39:26.417835 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.417746 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 23:39:26.418435 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.418417 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientMemory" Jul 13 23:39:26.418530 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.418448 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 23:39:26.418530 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:26.418459 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeHasSufficientPID" Jul 13 23:39:27.639882 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:27.639836 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-62.ec2.internal\" not found" node="ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.644399 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:27.644384 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-62.ec2.internal\" not found" node="ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.646425 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:27.646411 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:27.666302 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.666284 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca1bd193287f8efefa5763f26818fcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"cca1bd193287f8efefa5763f26818fcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.666361 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.666309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4da66e21bfcdc736ed59a24d3007918-config\") pod \"kube-apiserver-proxy-ip-10-0-136-62.ec2.internal\" (UID: \"e4da66e21bfcdc736ed59a24d3007918\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.666361 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.666327 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cca1bd193287f8efefa5763f26818fcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"cca1bd193287f8efefa5763f26818fcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.746904 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:27.746882 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:27.767254 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.767232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4da66e21bfcdc736ed59a24d3007918-config\") pod \"kube-apiserver-proxy-ip-10-0-136-62.ec2.internal\" (UID: \"e4da66e21bfcdc736ed59a24d3007918\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.767315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.767260 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cca1bd193287f8efefa5763f26818fcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"cca1bd193287f8efefa5763f26818fcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.767315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.767278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca1bd193287f8efefa5763f26818fcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"cca1bd193287f8efefa5763f26818fcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.767377 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.767317 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca1bd193287f8efefa5763f26818fcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"cca1bd193287f8efefa5763f26818fcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.767377 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.767348 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4da66e21bfcdc736ed59a24d3007918-config\") pod \"kube-apiserver-proxy-ip-10-0-136-62.ec2.internal\" (UID: \"e4da66e21bfcdc736ed59a24d3007918\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.767435 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.767348 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cca1bd193287f8efefa5763f26818fcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal\" (UID: \"cca1bd193287f8efefa5763f26818fcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.847687 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:27.847621 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:27.943152 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.943114 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.947259 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:27.947186 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jul 13 23:39:27.948267 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:27.948247 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.048665 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:28.048634 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.149161 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:28.149098 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.249649 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:28.249624 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.308091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.308064 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 23:39:28.308548 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.308215 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 23:39:28.350612 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:28.350584 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.373040 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.373003 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 23:34:27 +0000 UTC" deadline="2028-03-14 21:12:36.457192544 +0000 UTC" Jul 13 23:39:28.373040 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.373028 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14637h33m8.084167775s" Jul 13 23:39:28.451436 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:28.451367 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.508518 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:28.508479 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca1bd193287f8efefa5763f26818fcb.slice/crio-d9e38c2ce534ecafdcf73106afc140829ae3bb652de2b33f7535ef62c82dfbc4 WatchSource:0}: Error finding container d9e38c2ce534ecafdcf73106afc140829ae3bb652de2b33f7535ef62c82dfbc4: Status 404 returned error can't find the container with id d9e38c2ce534ecafdcf73106afc140829ae3bb652de2b33f7535ef62c82dfbc4 Jul 13 23:39:28.509211 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:28.509187 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4da66e21bfcdc736ed59a24d3007918.slice/crio-58ca6747df6051ea81a455124b84a2821143d46d49bd0102a60e0a3ed3d38aa2 WatchSource:0}: Error finding container 58ca6747df6051ea81a455124b84a2821143d46d49bd0102a60e0a3ed3d38aa2: Status 404 returned error can't find the container with id 58ca6747df6051ea81a455124b84a2821143d46d49bd0102a60e0a3ed3d38aa2 Jul 13 23:39:28.513460 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.513441 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 23:39:28.552290 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:28.552265 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.625124 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.625100 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 23:39:28.653060 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:28.653029 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.720140 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.720063 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 23:39:28.754081 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:28.754039 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-62.ec2.internal\" not found" Jul 13 23:39:28.800922 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.800898 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 23:39:28.864709 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.864544 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" Jul 13 23:39:28.874889 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.874757 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 23:39:28.875940 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.875811 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" Jul 13 23:39:28.883756 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:28.883735 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 23:39:29.344937 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.344905 2557 apiserver.go:52] "Watching apiserver" Jul 13 23:39:29.352565 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.352538 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 23:39:29.352955 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.352927 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-nvn8n","openshift-dns/node-resolver-vs9qk","openshift-multus/multus-8wgn2","openshift-multus/multus-additional-cni-plugins-snlc4","openshift-multus/network-metrics-daemon-mbbz9","openshift-network-diagnostics/network-check-target-j5fqw","kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx","openshift-image-registry/node-ca-gscfc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal","openshift-network-operator/iptables-alerter-gtz8q","openshift-ovn-kubernetes/ovnkube-node-zd87m","kube-system/global-pull-secret-syncer-5vtl5","kube-system/konnectivity-agent-kmrss"] Jul 13 23:39:29.355687 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.355663 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.355793 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.355767 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:29.358013 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.357990 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.360446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.360384 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.360870 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.360805 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 23:39:29.361010 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.360994 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r9wgm\"" Jul 13 23:39:29.361134 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.361118 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 23:39:29.362651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.362617 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.363788 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.363769 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pj4hj\"" Jul 13 23:39:29.363977 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.363960 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 23:39:29.364058 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.363966 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 23:39:29.364782 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.364638 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 23:39:29.364890 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.364857 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 23:39:29.365036 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.365014 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:29.365113 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.365075 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:29.365478 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.365461 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 23:39:29.365574 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.365495 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 23:39:29.365574 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.365549 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 23:39:29.365681 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.365665 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fnkhm\"" Jul 13 23:39:29.367093 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.367074 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:29.367167 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.367139 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:29.369263 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.369244 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.371508 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.371462 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 23:39:29.371610 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.371466 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.371610 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.371561 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kvcdm\"" Jul 13 23:39:29.371725 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.371618 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 23:39:29.373724 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.373706 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.374165 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.374149 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 23:39:29.374254 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.374220 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 23:39:29.374254 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.374244 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 23:39:29.374365 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.374349 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gs2f2\"" Jul 13 23:39:29.375724 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.375702 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fnt8\" (UniqueName: \"kubernetes.io/projected/f6627cc2-5cf1-44ff-af0d-7ad75a669105-kube-api-access-6fnt8\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.375840 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.375740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-daemon-config\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.375840 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.375764 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-etc-kubernetes\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.375840 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.375790 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-cni-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376004 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.375814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0117ae8c-bf88-404d-9adf-025edbd8afb2-cni-binary-copy\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376004 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.375901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-hostroot\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376004 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.375923 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-conf-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376004 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.375971 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbpph\" (UniqueName: \"kubernetes.io/projected/219c1d5e-bc7c-4608-816e-982173569fa7-kube-api-access-nbpph\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bcab85d-5d09-44f9-906a-f2a1a9455253-dbus\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376033 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-cnibin\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-kubelet\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376098 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376121 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-netns\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-multus-certs\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376172 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-k8s-cni-cncf-io\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376197 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-os-release\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-cni-binary-copy\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.376293 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376277 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376299 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-cni-multus\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376317 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-os-release\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376377 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376400 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376440 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376496 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-socket-dir-parent\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376323 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376554 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-cni-bin\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376576 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376625 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376627 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-system-cni-dir\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376655 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xlffv\"" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376660 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6627cc2-5cf1-44ff-af0d-7ad75a669105-tmp-dir\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376687 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-system-cni-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.376764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376719 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j98kx\" (UniqueName: \"kubernetes.io/projected/0117ae8c-bf88-404d-9adf-025edbd8afb2-kube-api-access-j98kx\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.377443 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376776 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8mjc\" (UniqueName: \"kubernetes.io/projected/a062baa3-3416-400c-8bad-dd6c9379758e-kube-api-access-k8mjc\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:29.377443 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376801 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bcab85d-5d09-44f9-906a-f2a1a9455253-kubelet-config\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.377443 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376841 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-cnibin\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.377443 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.376883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6627cc2-5cf1-44ff-af0d-7ad75a669105-hosts-file\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.378506 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.378486 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.378988 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.378967 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 23:39:29.379226 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.379209 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 23:39:29.379320 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.379227 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 23:39:29.379320 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.379236 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vh992\"" Jul 13 23:39:29.380886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.380853 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 23:39:29.380886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.380875 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vjqwz\"" Jul 13 23:39:29.381021 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.380890 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 23:39:29.381123 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.381104 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.381314 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.381292 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 23:39:29.383713 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.383694 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 23:39:29.384381 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.384326 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 23:39:29.384381 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.384327 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 23:39:29.384381 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.384364 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wnhqt\"" Jul 13 23:39:29.384585 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.384361 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 23:39:29.384585 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.384364 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 23:39:29.384585 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.384479 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 23:39:29.400064 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.400038 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zgmct" Jul 13 23:39:29.407336 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.407313 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zgmct" Jul 13 23:39:29.465686 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.465660 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 23:39:29.477413 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477384 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0117ae8c-bf88-404d-9adf-025edbd8afb2-cni-binary-copy\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.477556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-hostroot\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.477556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-registration-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.477556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysconfig\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.477556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477492 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-kubernetes\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.477556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477525 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-hostroot\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.477556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a369c6ef-45f2-4cf0-865a-38492e95645b-tmp\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.477829 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbpph\" (UniqueName: \"kubernetes.io/projected/219c1d5e-bc7c-4608-816e-982173569fa7-kube-api-access-nbpph\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.477829 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477624 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f571c1e3-d0e3-49a7-9afb-75e2e7256724-iptables-alerter-script\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.477829 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-multus-certs\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.477829 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477680 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.477829 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477715 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-multus-certs\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.477829 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-cni-binary-copy\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.477829 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.477829 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-cni-multus\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477888 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-cni-multus\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477920 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-systemd\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.477969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-ovn\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-cni-bin\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478004 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-os-release\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478096 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-os-release\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478103 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0117ae8c-bf88-404d-9adf-025edbd8afb2-cni-binary-copy\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478125 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2k29\" (UniqueName: \"kubernetes.io/projected/69b77072-2f31-4b3b-9411-c3647d1d2b90-kube-api-access-g2k29\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.478202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478173 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478209 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.478248 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478264 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-socket-dir-parent\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478291 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-cni-bin\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478288 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-cni-binary-copy\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.478305 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs podName:a062baa3-3416-400c-8bad-dd6c9379758e nodeName:}" failed. No retries permitted until 2026-07-13 23:39:29.978285992 +0000 UTC m=+2.945981824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs") pod "network-metrics-daemon-mbbz9" (UID: "a062baa3-3416-400c-8bad-dd6c9379758e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478330 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-kubelet\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478340 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-cni-bin\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478339 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-socket-dir-parent\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-systemd-units\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478382 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-modprobe-d\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478405 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69b77072-2f31-4b3b-9411-c3647d1d2b90-serviceca\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478432 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-system-cni-dir\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478457 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j98kx\" (UniqueName: \"kubernetes.io/projected/0117ae8c-bf88-404d-9adf-025edbd8afb2-kube-api-access-j98kx\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478482 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b6719fb-cecc-47f8-a1da-67ebee71253d-konnectivity-ca\") pod \"konnectivity-agent-kmrss\" (UID: \"8b6719fb-cecc-47f8-a1da-67ebee71253d\") " pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478490 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-system-cni-dir\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.478719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478504 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-slash\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478528 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-var-lib-kubelet\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478555 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8mjc\" (UniqueName: \"kubernetes.io/projected/a062baa3-3416-400c-8bad-dd6c9379758e-kube-api-access-k8mjc\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478582 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-cnibin\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478606 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fnt8\" (UniqueName: \"kubernetes.io/projected/f6627cc2-5cf1-44ff-af0d-7ad75a669105-kube-api-access-6fnt8\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478652 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-etc-kubernetes\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-run-ovn-kubernetes\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478682 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-cnibin\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478692 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478712 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzllw\" (UniqueName: \"kubernetes.io/projected/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-kube-api-access-jzllw\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478734 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-etc-kubernetes\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478736 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69b77072-2f31-4b3b-9411-c3647d1d2b90-host\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-conf-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478807 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bcab85d-5d09-44f9-906a-f2a1a9455253-dbus\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478869 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-conf-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478876 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-cnibin\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478915 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-cnibin\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.479432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478915 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-kubelet\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478946 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-etc-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478948 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-var-lib-kubelet\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.478984 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479012 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bcab85d-5d09-44f9-906a-f2a1a9455253-dbus\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479031 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-node-log\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479054 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479070 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-netns\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479084 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-cni-netd\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479103 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-run\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479141 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-netns\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.479154 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479186 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-host\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.479194 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret podName:6bcab85d-5d09-44f9-906a-f2a1a9455253 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:29.97917941 +0000 UTC m=+2.946875251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret") pod "global-pull-secret-syncer-5vtl5" (UID: "6bcab85d-5d09-44f9-906a-f2a1a9455253") : object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479221 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-k8s-cni-cncf-io\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-os-release\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479253 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovn-node-metrics-cert\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479277 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovnkube-script-lib\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479309 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-host-run-k8s-cni-cncf-io\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479312 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwmlk\" (UniqueName: \"kubernetes.io/projected/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-kube-api-access-vwmlk\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479339 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/219c1d5e-bc7c-4608-816e-982173569fa7-os-release\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-run-netns\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479386 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-var-lib-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovnkube-config\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479428 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-sys\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479450 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-lib-modules\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-tuned\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479484 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-log-socket\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479509 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-sys-fs\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479651 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b6719fb-cecc-47f8-a1da-67ebee71253d-agent-certs\") pod \"konnectivity-agent-kmrss\" (UID: \"8b6719fb-cecc-47f8-a1da-67ebee71253d\") " pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479685 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-systemd\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6627cc2-5cf1-44ff-af0d-7ad75a669105-tmp-dir\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.480737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-system-cni-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479807 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-env-overrides\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479836 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-system-cni-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479846 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx8mt\" (UniqueName: \"kubernetes.io/projected/a369c6ef-45f2-4cf0-865a-38492e95645b-kube-api-access-rx8mt\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479871 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f571c1e3-d0e3-49a7-9afb-75e2e7256724-host-slash\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479906 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-device-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479931 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bcab85d-5d09-44f9-906a-f2a1a9455253-kubelet-config\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479971 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/219c1d5e-bc7c-4608-816e-982173569fa7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479966 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6627cc2-5cf1-44ff-af0d-7ad75a669105-hosts-file\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.479990 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bcab85d-5d09-44f9-906a-f2a1a9455253-kubelet-config\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480034 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-daemon-config\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480048 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6627cc2-5cf1-44ff-af0d-7ad75a669105-hosts-file\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480059 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6627cc2-5cf1-44ff-af0d-7ad75a669105-tmp-dir\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480098 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-socket-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysctl-d\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480182 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysctl-conf\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.481286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480203 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2pkb\" (UniqueName: \"kubernetes.io/projected/f571c1e3-d0e3-49a7-9afb-75e2e7256724-kube-api-access-m2pkb\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.481849 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480226 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-cni-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.481849 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480322 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-cni-dir\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.481849 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.480525 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0117ae8c-bf88-404d-9adf-025edbd8afb2-multus-daemon-config\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.484386 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.484350 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 23:39:29.488297 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.488276 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j98kx\" (UniqueName: \"kubernetes.io/projected/0117ae8c-bf88-404d-9adf-025edbd8afb2-kube-api-access-j98kx\") pod \"multus-8wgn2\" (UID: \"0117ae8c-bf88-404d-9adf-025edbd8afb2\") " pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.488297 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.488291 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fnt8\" (UniqueName: \"kubernetes.io/projected/f6627cc2-5cf1-44ff-af0d-7ad75a669105-kube-api-access-6fnt8\") pod \"node-resolver-vs9qk\" (UID: \"f6627cc2-5cf1-44ff-af0d-7ad75a669105\") " pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.488436 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.488275 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbpph\" (UniqueName: \"kubernetes.io/projected/219c1d5e-bc7c-4608-816e-982173569fa7-kube-api-access-nbpph\") pod \"multus-additional-cni-plugins-snlc4\" (UID: \"219c1d5e-bc7c-4608-816e-982173569fa7\") " pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.488436 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.488321 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8mjc\" (UniqueName: \"kubernetes.io/projected/a062baa3-3416-400c-8bad-dd6c9379758e-kube-api-access-k8mjc\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:29.514588 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.514540 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" event={"ID":"cca1bd193287f8efefa5763f26818fcb","Type":"ContainerStarted","Data":"d9e38c2ce534ecafdcf73106afc140829ae3bb652de2b33f7535ef62c82dfbc4"} Jul 13 23:39:29.515872 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.515835 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" event={"ID":"e4da66e21bfcdc736ed59a24d3007918","Type":"ContainerStarted","Data":"58ca6747df6051ea81a455124b84a2821143d46d49bd0102a60e0a3ed3d38aa2"} Jul 13 23:39:29.581477 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:29.581477 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581484 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2k29\" (UniqueName: \"kubernetes.io/projected/69b77072-2f31-4b3b-9411-c3647d1d2b90-kube-api-access-g2k29\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-kubelet\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-systemd-units\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581571 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-modprobe-d\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581594 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69b77072-2f31-4b3b-9411-c3647d1d2b90-serviceca\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b6719fb-cecc-47f8-a1da-67ebee71253d-konnectivity-ca\") pod \"konnectivity-agent-kmrss\" (UID: \"8b6719fb-cecc-47f8-a1da-67ebee71253d\") " pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581654 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-slash\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581673 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-var-lib-kubelet\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581705 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-run-ovn-kubernetes\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581728 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzllw\" (UniqueName: \"kubernetes.io/projected/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-kube-api-access-jzllw\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.581748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581741 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-slash\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581757 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69b77072-2f31-4b3b-9411-c3647d1d2b90-host\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581759 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-modprobe-d\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-etc-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581809 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69b77072-2f31-4b3b-9411-c3647d1d2b90-host\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581811 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-var-lib-kubelet\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581863 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-systemd-units\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581865 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-node-log\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581870 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-run-ovn-kubernetes\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581898 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-node-log\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-cni-netd\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581930 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-run\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581946 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-etc-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581950 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-host\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581979 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovn-node-metrics-cert\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581983 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582005 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovnkube-script-lib\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582048 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwmlk\" (UniqueName: \"kubernetes.io/projected/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-kube-api-access-vwmlk\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.582667 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582364 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-run-netns\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582667 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.581615 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-kubelet\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582667 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582413 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-var-lib-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582667 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582443 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-cni-netd\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582667 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582544 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-run\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.582667 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582647 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-run-netns\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.582845 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582701 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-host\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.582845 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582774 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69b77072-2f31-4b3b-9411-c3647d1d2b90-serviceca\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.582845 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.582448 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovnkube-config\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-sys\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583089 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-lib-modules\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583097 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-var-lib-openvswitch\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-tuned\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583147 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b6719fb-cecc-47f8-a1da-67ebee71253d-konnectivity-ca\") pod \"konnectivity-agent-kmrss\" (UID: \"8b6719fb-cecc-47f8-a1da-67ebee71253d\") " pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583166 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-sys\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583169 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovnkube-config\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583148 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-log-socket\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583328 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-sys-fs\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583331 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-log-socket\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b6719fb-cecc-47f8-a1da-67ebee71253d-agent-certs\") pod \"konnectivity-agent-kmrss\" (UID: \"8b6719fb-cecc-47f8-a1da-67ebee71253d\") " pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583459 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-sys-fs\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583521 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-systemd\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583609 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovnkube-script-lib\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583557 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583677 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-env-overrides\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.583886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583739 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-systemd\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx8mt\" (UniqueName: \"kubernetes.io/projected/a369c6ef-45f2-4cf0-865a-38492e95645b-kube-api-access-rx8mt\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583798 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f571c1e3-d0e3-49a7-9afb-75e2e7256724-host-slash\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583803 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583839 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-lib-modules\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583890 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f571c1e3-d0e3-49a7-9afb-75e2e7256724-host-slash\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.583997 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-device-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-socket-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584128 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-device-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584132 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysctl-d\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584244 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-socket-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584312 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysctl-conf\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584345 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysctl-d\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2pkb\" (UniqueName: \"kubernetes.io/projected/f571c1e3-d0e3-49a7-9afb-75e2e7256724-kube-api-access-m2pkb\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584365 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-env-overrides\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584388 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-registration-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysconfig\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.584768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584443 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-kubernetes\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584465 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysctl-conf\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584557 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-registration-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584599 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a369c6ef-45f2-4cf0-865a-38492e95645b-tmp\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584621 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-sysconfig\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584635 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f571c1e3-d0e3-49a7-9afb-75e2e7256724-iptables-alerter-script\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584764 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584803 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-kubernetes\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584806 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584949 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.584880 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-systemd\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.585003 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-ovn\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.585033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-cni-bin\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.585068 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.585235 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-systemd\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.585311 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-run-ovn\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.585317 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f571c1e3-d0e3-49a7-9afb-75e2e7256724-iptables-alerter-script\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.585571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.585352 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-host-cni-bin\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.587201 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.586653 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b6719fb-cecc-47f8-a1da-67ebee71253d-agent-certs\") pod \"konnectivity-agent-kmrss\" (UID: \"8b6719fb-cecc-47f8-a1da-67ebee71253d\") " pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:29.587201 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.587107 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a369c6ef-45f2-4cf0-865a-38492e95645b-tmp\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.587352 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.587302 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 23:39:29.587352 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.587332 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 23:39:29.587352 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.587347 2557 projected.go:196] Error preparing data for projected volume kube-api-access-p9gvj for pod openshift-network-diagnostics/network-check-target-j5fqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:29.587507 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.587421 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj podName:0682b2bb-d5b8-462f-80cf-a45595cd7ed1 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:30.087404178 +0000 UTC m=+3.055100015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p9gvj" (UniqueName: "kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj") pod "network-check-target-j5fqw" (UID: "0682b2bb-d5b8-462f-80cf-a45595cd7ed1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:29.588101 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.588068 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a369c6ef-45f2-4cf0-865a-38492e95645b-etc-tuned\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.588716 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.588661 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-ovn-node-metrics-cert\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.590752 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.590720 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzllw\" (UniqueName: \"kubernetes.io/projected/dad32e11-f8f3-44f3-87a1-6c03fdd26a76-kube-api-access-jzllw\") pod \"ovnkube-node-zd87m\" (UID: \"dad32e11-f8f3-44f3-87a1-6c03fdd26a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.590911 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.590891 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2k29\" (UniqueName: \"kubernetes.io/projected/69b77072-2f31-4b3b-9411-c3647d1d2b90-kube-api-access-g2k29\") pod \"node-ca-gscfc\" (UID: \"69b77072-2f31-4b3b-9411-c3647d1d2b90\") " pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.591058 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.591038 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwmlk\" (UniqueName: \"kubernetes.io/projected/6dfd3cba-c98c-4384-8c99-20fc006ed9cd-kube-api-access-vwmlk\") pod \"aws-ebs-csi-driver-node-sbmkx\" (UID: \"6dfd3cba-c98c-4384-8c99-20fc006ed9cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.597372 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.597319 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx8mt\" (UniqueName: \"kubernetes.io/projected/a369c6ef-45f2-4cf0-865a-38492e95645b-kube-api-access-rx8mt\") pod \"tuned-nvn8n\" (UID: \"a369c6ef-45f2-4cf0-865a-38492e95645b\") " pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.597519 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.597500 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2pkb\" (UniqueName: \"kubernetes.io/projected/f571c1e3-d0e3-49a7-9afb-75e2e7256724-kube-api-access-m2pkb\") pod \"iptables-alerter-gtz8q\" (UID: \"f571c1e3-d0e3-49a7-9afb-75e2e7256724\") " pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.640903 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.640879 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 23:39:29.673045 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.673020 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vs9qk" Jul 13 23:39:29.679669 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.679652 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8wgn2" Jul 13 23:39:29.689424 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.689401 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snlc4" Jul 13 23:39:29.694164 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.694149 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" Jul 13 23:39:29.700813 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.700797 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" Jul 13 23:39:29.706476 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.706459 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gscfc" Jul 13 23:39:29.713090 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.713074 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:29.721710 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.721691 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gtz8q" Jul 13 23:39:29.726478 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.726461 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:29.987627 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.987541 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:29.987627 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:29.987601 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:29.987848 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.987702 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:29.987848 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.987762 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret podName:6bcab85d-5d09-44f9-906a-f2a1a9455253 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:30.98774338 +0000 UTC m=+3.955439208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret") pod "global-pull-secret-syncer-5vtl5" (UID: "6bcab85d-5d09-44f9-906a-f2a1a9455253") : object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:29.987848 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.987701 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:29.987995 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:29.987867 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs podName:a062baa3-3416-400c-8bad-dd6c9379758e nodeName:}" failed. No retries permitted until 2026-07-13 23:39:30.987851095 +0000 UTC m=+3.955546926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs") pod "network-metrics-daemon-mbbz9" (UID: "a062baa3-3416-400c-8bad-dd6c9379758e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:30.088341 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.088304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:30.088513 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.088494 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 23:39:30.088562 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.088516 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 23:39:30.088562 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.088531 2557 projected.go:196] Error preparing data for projected volume kube-api-access-p9gvj for pod openshift-network-diagnostics/network-check-target-j5fqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:30.088656 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.088589 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj podName:0682b2bb-d5b8-462f-80cf-a45595cd7ed1 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:31.088572703 +0000 UTC m=+4.056268541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9gvj" (UniqueName: "kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj") pod "network-check-target-j5fqw" (UID: "0682b2bb-d5b8-462f-80cf-a45595cd7ed1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:30.399455 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:30.399429 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda369c6ef_45f2_4cf0_865a_38492e95645b.slice/crio-12c6c7a4133983899ee65a84d3943a4f985dbb008ca0f021a675a3e5aeb81a09 WatchSource:0}: Error finding container 12c6c7a4133983899ee65a84d3943a4f985dbb008ca0f021a675a3e5aeb81a09: Status 404 returned error can't find the container with id 12c6c7a4133983899ee65a84d3943a4f985dbb008ca0f021a675a3e5aeb81a09 Jul 13 23:39:30.401119 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:30.401086 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf571c1e3_d0e3_49a7_9afb_75e2e7256724.slice/crio-0e35e3314cbb4c82c9ea294ac02071cb46949433fd122ab4250885fb588d7d15 WatchSource:0}: Error finding container 0e35e3314cbb4c82c9ea294ac02071cb46949433fd122ab4250885fb588d7d15: Status 404 returned error can't find the container with id 0e35e3314cbb4c82c9ea294ac02071cb46949433fd122ab4250885fb588d7d15 Jul 13 23:39:30.401790 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:30.401730 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfd3cba_c98c_4384_8c99_20fc006ed9cd.slice/crio-c7757849a0238436079253ba6c78f31daf45b96052e037309119c14d5a45fb0e WatchSource:0}: Error finding container c7757849a0238436079253ba6c78f31daf45b96052e037309119c14d5a45fb0e: Status 404 returned error can't find the container with id c7757849a0238436079253ba6c78f31daf45b96052e037309119c14d5a45fb0e Jul 13 23:39:30.403227 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:30.403206 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b77072_2f31_4b3b_9411_c3647d1d2b90.slice/crio-57c1d539eccdbfd8363ee6f1fc30693bbb5838ffc2b78ebe3eee7194c99fec5d WatchSource:0}: Error finding container 57c1d539eccdbfd8363ee6f1fc30693bbb5838ffc2b78ebe3eee7194c99fec5d: Status 404 returned error can't find the container with id 57c1d539eccdbfd8363ee6f1fc30693bbb5838ffc2b78ebe3eee7194c99fec5d Jul 13 23:39:30.406318 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:30.406296 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219c1d5e_bc7c_4608_816e_982173569fa7.slice/crio-d8b7c1bfacf742795273a192c8d1dd80313ac793f16e6faef0ecd3cfc4a4f3f2 WatchSource:0}: Error finding container d8b7c1bfacf742795273a192c8d1dd80313ac793f16e6faef0ecd3cfc4a4f3f2: Status 404 returned error can't find the container with id d8b7c1bfacf742795273a192c8d1dd80313ac793f16e6faef0ecd3cfc4a4f3f2 Jul 13 23:39:30.407932 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:30.407911 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6719fb_cecc_47f8_a1da_67ebee71253d.slice/crio-47a687e967023e9c1f3593879c1099259b5c72c1bb92d09cbed880fcbe10e5f1 WatchSource:0}: Error finding container 47a687e967023e9c1f3593879c1099259b5c72c1bb92d09cbed880fcbe10e5f1: Status 404 returned error can't find the container with id 47a687e967023e9c1f3593879c1099259b5c72c1bb92d09cbed880fcbe10e5f1 Jul 13 23:39:30.409343 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:30.409319 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0117ae8c_bf88_404d_9adf_025edbd8afb2.slice/crio-ffcd572f0749dce7a35dbf8887b8376a3e94a2d5bd2e5952abcdca91e16d3582 WatchSource:0}: Error finding container ffcd572f0749dce7a35dbf8887b8376a3e94a2d5bd2e5952abcdca91e16d3582: Status 404 returned error can't find the container with id ffcd572f0749dce7a35dbf8887b8376a3e94a2d5bd2e5952abcdca91e16d3582 Jul 13 23:39:30.410319 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.410135 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 23:34:29 +0000 UTC" deadline="2028-04-15 19:48:41.85664991 +0000 UTC" Jul 13 23:39:30.410319 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.410161 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15404h9m11.446493419s" Jul 13 23:39:30.437667 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:39:30.437648 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6627cc2_5cf1_44ff_af0d_7ad75a669105.slice/crio-07142b7172c03d1d50eea7307a41a667e1171c9c51500d27a605d7f3e46cb7d6 WatchSource:0}: Error finding container 07142b7172c03d1d50eea7307a41a667e1171c9c51500d27a605d7f3e46cb7d6: Status 404 returned error can't find the container with id 07142b7172c03d1d50eea7307a41a667e1171c9c51500d27a605d7f3e46cb7d6 Jul 13 23:39:30.510090 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.509932 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:30.510177 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.510006 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:30.510244 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.510150 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:30.510287 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.510265 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:30.519186 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.519161 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vs9qk" event={"ID":"f6627cc2-5cf1-44ff-af0d-7ad75a669105","Type":"ContainerStarted","Data":"07142b7172c03d1d50eea7307a41a667e1171c9c51500d27a605d7f3e46cb7d6"} Jul 13 23:39:30.520183 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.520155 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8wgn2" event={"ID":"0117ae8c-bf88-404d-9adf-025edbd8afb2","Type":"ContainerStarted","Data":"ffcd572f0749dce7a35dbf8887b8376a3e94a2d5bd2e5952abcdca91e16d3582"} Jul 13 23:39:30.521233 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.521212 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kmrss" event={"ID":"8b6719fb-cecc-47f8-a1da-67ebee71253d","Type":"ContainerStarted","Data":"47a687e967023e9c1f3593879c1099259b5c72c1bb92d09cbed880fcbe10e5f1"} Jul 13 23:39:30.522248 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.522228 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snlc4" event={"ID":"219c1d5e-bc7c-4608-816e-982173569fa7","Type":"ContainerStarted","Data":"d8b7c1bfacf742795273a192c8d1dd80313ac793f16e6faef0ecd3cfc4a4f3f2"} Jul 13 23:39:30.523521 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.523503 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gscfc" event={"ID":"69b77072-2f31-4b3b-9411-c3647d1d2b90","Type":"ContainerStarted","Data":"57c1d539eccdbfd8363ee6f1fc30693bbb5838ffc2b78ebe3eee7194c99fec5d"} Jul 13 23:39:30.524676 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.524653 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gtz8q" event={"ID":"f571c1e3-d0e3-49a7-9afb-75e2e7256724","Type":"ContainerStarted","Data":"0e35e3314cbb4c82c9ea294ac02071cb46949433fd122ab4250885fb588d7d15"} Jul 13 23:39:30.526689 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.526669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" event={"ID":"e4da66e21bfcdc736ed59a24d3007918","Type":"ContainerStarted","Data":"f56f22a8cf56d696ddd26fd91d634c46dd5753d7793e5a7d4998670a2ff23c8a"} Jul 13 23:39:30.528638 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.528619 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"ae08b0e0769b178aa5e0cb10c3b139afbbc7794b346b911f77e5b2de7273a68b"} Jul 13 23:39:30.529625 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.529604 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" event={"ID":"6dfd3cba-c98c-4384-8c99-20fc006ed9cd","Type":"ContainerStarted","Data":"c7757849a0238436079253ba6c78f31daf45b96052e037309119c14d5a45fb0e"} Jul 13 23:39:30.532102 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.532062 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" event={"ID":"a369c6ef-45f2-4cf0-865a-38492e95645b","Type":"ContainerStarted","Data":"12c6c7a4133983899ee65a84d3943a4f985dbb008ca0f021a675a3e5aeb81a09"} Jul 13 23:39:30.545184 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.545133 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-62.ec2.internal" podStartSLOduration=2.545117367 podStartE2EDuration="2.545117367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:30.544958949 +0000 UTC m=+3.512654800" watchObservedRunningTime="2026-07-13 23:39:30.545117367 +0000 UTC m=+3.512813218" Jul 13 23:39:30.997029 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.996946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:30.997187 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:30.997028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:30.997187 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.997149 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:30.997308 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.997239 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs podName:a062baa3-3416-400c-8bad-dd6c9379758e nodeName:}" failed. No retries permitted until 2026-07-13 23:39:32.997220606 +0000 UTC m=+5.964916437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs") pod "network-metrics-daemon-mbbz9" (UID: "a062baa3-3416-400c-8bad-dd6c9379758e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:30.997369 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.997328 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:30.997369 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:30.997362 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret podName:6bcab85d-5d09-44f9-906a-f2a1a9455253 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:32.997351159 +0000 UTC m=+5.965046986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret") pod "global-pull-secret-syncer-5vtl5" (UID: "6bcab85d-5d09-44f9-906a-f2a1a9455253") : object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:31.097486 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:31.097451 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:31.097668 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:31.097650 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 23:39:31.097741 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:31.097676 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 23:39:31.097741 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:31.097689 2557 projected.go:196] Error preparing data for projected volume kube-api-access-p9gvj for pod openshift-network-diagnostics/network-check-target-j5fqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:31.097860 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:31.097747 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj podName:0682b2bb-d5b8-462f-80cf-a45595cd7ed1 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:33.097729995 +0000 UTC m=+6.065425827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9gvj" (UniqueName: "kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj") pod "network-check-target-j5fqw" (UID: "0682b2bb-d5b8-462f-80cf-a45595cd7ed1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:31.410503 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:31.410399 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 23:34:29 +0000 UTC" deadline="2028-01-07 00:58:33.153333551 +0000 UTC" Jul 13 23:39:31.410503 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:31.410436 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13009h19m1.742902524s" Jul 13 23:39:31.512650 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:31.512619 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:31.512812 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:31.512757 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:31.554308 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:31.554271 2557 generic.go:356] "Generic (PLEG): container finished" podID="cca1bd193287f8efefa5763f26818fcb" containerID="e1cf5421d5595cc0f69fd59049c85d5451315936687e3822903f71ecc9319077" exitCode=0 Jul 13 23:39:31.555178 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:31.555153 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" event={"ID":"cca1bd193287f8efefa5763f26818fcb","Type":"ContainerDied","Data":"e1cf5421d5595cc0f69fd59049c85d5451315936687e3822903f71ecc9319077"} Jul 13 23:39:32.510496 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:32.510333 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:32.510496 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:32.510462 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:32.511063 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:32.510675 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:32.511063 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:32.510792 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:32.575462 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:32.575420 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" event={"ID":"cca1bd193287f8efefa5763f26818fcb","Type":"ContainerStarted","Data":"e90e17a5096e41a358ab8b41df990b1bb56b578afa635b3cbc91e555dd4bce4c"} Jul 13 23:39:33.014746 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:33.014699 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:33.014945 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:33.014800 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:33.015005 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.014951 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:33.015058 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.015009 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs podName:a062baa3-3416-400c-8bad-dd6c9379758e nodeName:}" failed. No retries permitted until 2026-07-13 23:39:37.014991712 +0000 UTC m=+9.982687544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs") pod "network-metrics-daemon-mbbz9" (UID: "a062baa3-3416-400c-8bad-dd6c9379758e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:33.015393 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.015373 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:33.015488 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.015429 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret podName:6bcab85d-5d09-44f9-906a-f2a1a9455253 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:37.015414843 +0000 UTC m=+9.983110673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret") pod "global-pull-secret-syncer-5vtl5" (UID: "6bcab85d-5d09-44f9-906a-f2a1a9455253") : object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:33.115547 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:33.115507 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:33.115861 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.115700 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 23:39:33.115861 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.115724 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 23:39:33.115861 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.115737 2557 projected.go:196] Error preparing data for projected volume kube-api-access-p9gvj for pod openshift-network-diagnostics/network-check-target-j5fqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:33.115861 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.115796 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj podName:0682b2bb-d5b8-462f-80cf-a45595cd7ed1 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:37.115776631 +0000 UTC m=+10.083472463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9gvj" (UniqueName: "kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj") pod "network-check-target-j5fqw" (UID: "0682b2bb-d5b8-462f-80cf-a45595cd7ed1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:33.510595 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:33.510189 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:33.510595 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:33.510338 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:34.510066 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:34.510034 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:34.510245 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:34.510166 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:34.510559 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:34.510535 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:34.510661 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:34.510642 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:35.509738 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:35.509704 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:35.509936 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:35.509877 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:36.510523 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:36.510066 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:36.510523 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:36.510085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:36.510523 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:36.510196 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:36.510523 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:36.510332 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:37.051178 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:37.051142 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:37.051369 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:37.051206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:37.051369 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.051287 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:37.051369 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.051294 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:37.051369 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.051354 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret podName:6bcab85d-5d09-44f9-906a-f2a1a9455253 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:45.051334135 +0000 UTC m=+18.019029969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret") pod "global-pull-secret-syncer-5vtl5" (UID: "6bcab85d-5d09-44f9-906a-f2a1a9455253") : object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:37.051369 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.051372 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs podName:a062baa3-3416-400c-8bad-dd6c9379758e nodeName:}" failed. No retries permitted until 2026-07-13 23:39:45.051362423 +0000 UTC m=+18.019058262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs") pod "network-metrics-daemon-mbbz9" (UID: "a062baa3-3416-400c-8bad-dd6c9379758e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:37.151648 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:37.151611 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:37.151857 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.151774 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 23:39:37.151857 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.151796 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 23:39:37.151857 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.151808 2557 projected.go:196] Error preparing data for projected volume kube-api-access-p9gvj for pod openshift-network-diagnostics/network-check-target-j5fqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:37.152019 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.151884 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj podName:0682b2bb-d5b8-462f-80cf-a45595cd7ed1 nodeName:}" failed. No retries permitted until 2026-07-13 23:39:45.151865498 +0000 UTC m=+18.119561327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9gvj" (UniqueName: "kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj") pod "network-check-target-j5fqw" (UID: "0682b2bb-d5b8-462f-80cf-a45595cd7ed1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:37.511439 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:37.510552 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:37.511439 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:37.510727 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:38.510687 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:38.510166 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:38.510687 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:38.510218 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:38.510687 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:38.510304 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:38.510687 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:38.510412 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:39.510144 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:39.510114 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:39.510588 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:39.510260 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:40.509834 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:40.509781 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:40.510012 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:40.509779 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:40.510012 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:40.509942 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:40.510012 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:40.509998 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:41.510615 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:41.510522 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:41.511079 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:41.510670 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:42.510549 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:42.510514 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:42.510730 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:42.510648 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:42.510730 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:42.510674 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:42.511150 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:42.510785 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:43.509934 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:43.509897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:43.510143 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:43.510030 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:44.509809 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:44.509775 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:44.510330 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:44.509775 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:44.510330 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:44.509925 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:44.510330 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:44.509990 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:45.112225 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:45.112137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:45.112225 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:45.112206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:45.112444 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.112315 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:45.112444 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.112393 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret podName:6bcab85d-5d09-44f9-906a-f2a1a9455253 nodeName:}" failed. No retries permitted until 2026-07-13 23:40:01.112374068 +0000 UTC m=+34.080069911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret") pod "global-pull-secret-syncer-5vtl5" (UID: "6bcab85d-5d09-44f9-906a-f2a1a9455253") : object "kube-system"/"original-pull-secret" not registered Jul 13 23:39:45.112444 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.112316 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:45.112586 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.112477 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs podName:a062baa3-3416-400c-8bad-dd6c9379758e nodeName:}" failed. No retries permitted until 2026-07-13 23:40:01.112459803 +0000 UTC m=+34.080155644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs") pod "network-metrics-daemon-mbbz9" (UID: "a062baa3-3416-400c-8bad-dd6c9379758e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:39:45.213073 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:45.213034 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:45.213256 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.213224 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 23:39:45.213256 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.213255 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 23:39:45.213355 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.213269 2557 projected.go:196] Error preparing data for projected volume kube-api-access-p9gvj for pod openshift-network-diagnostics/network-check-target-j5fqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:45.213355 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.213331 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj podName:0682b2bb-d5b8-462f-80cf-a45595cd7ed1 nodeName:}" failed. No retries permitted until 2026-07-13 23:40:01.213316683 +0000 UTC m=+34.181012530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9gvj" (UniqueName: "kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj") pod "network-check-target-j5fqw" (UID: "0682b2bb-d5b8-462f-80cf-a45595cd7ed1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:39:45.509868 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:45.509764 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:45.510278 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:45.509956 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:46.510355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:46.510319 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:46.510848 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:46.510324 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:46.510848 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:46.510445 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:46.510848 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:46.510514 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:47.511374 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:47.511246 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:47.511374 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:47.511361 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:48.510297 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:48.510258 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:48.510466 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:48.510273 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:48.510466 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:48.510381 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:48.510599 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:48.510471 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:49.511839 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.511513 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:49.512222 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:49.511862 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:49.608355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.608317 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vs9qk" event={"ID":"f6627cc2-5cf1-44ff-af0d-7ad75a669105","Type":"ContainerStarted","Data":"1995989e2e712bb5b51436dd4a95b40dea040623cd6ec139bbebb36991b703fa"} Jul 13 23:39:49.610868 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.610801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8wgn2" event={"ID":"0117ae8c-bf88-404d-9adf-025edbd8afb2","Type":"ContainerStarted","Data":"7ac39eda3636f31c8783ccc16ee1956ec282471a1ee7db142f1ee29a58c0449c"} Jul 13 23:39:49.612408 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.612383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kmrss" event={"ID":"8b6719fb-cecc-47f8-a1da-67ebee71253d","Type":"ContainerStarted","Data":"c74de8b39bb16ab60af4d32f924a4ca02c05e41afa20eb4930e74fe65da478bf"} Jul 13 23:39:49.613891 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.613869 2557 generic.go:356] "Generic (PLEG): container finished" podID="219c1d5e-bc7c-4608-816e-982173569fa7" containerID="dc809b9d6e6dbece359a5fde022d730c6724170c34f75e22fb9f23346841dc57" exitCode=0 Jul 13 23:39:49.613966 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.613934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snlc4" event={"ID":"219c1d5e-bc7c-4608-816e-982173569fa7","Type":"ContainerDied","Data":"dc809b9d6e6dbece359a5fde022d730c6724170c34f75e22fb9f23346841dc57"} Jul 13 23:39:49.615696 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.615672 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gscfc" event={"ID":"69b77072-2f31-4b3b-9411-c3647d1d2b90","Type":"ContainerStarted","Data":"48baad4f7b0b9a7ebcee17340218124c47a312536bf84833948575beb180b36e"} Jul 13 23:39:49.617414 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.617367 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" event={"ID":"6dfd3cba-c98c-4384-8c99-20fc006ed9cd","Type":"ContainerStarted","Data":"a816c8708362769f2d7dcae1dfd8247c82f5eacd68d262e7e0aba0b407ca8dbc"} Jul 13 23:39:49.618758 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.618732 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" event={"ID":"a369c6ef-45f2-4cf0-865a-38492e95645b","Type":"ContainerStarted","Data":"16c01c4980d038b803c61f2389b572a2f6741295ab569064d8bde3219b57e53b"} Jul 13 23:39:49.621378 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.621336 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-62.ec2.internal" podStartSLOduration=21.621304272 podStartE2EDuration="21.621304272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:32.591889845 +0000 UTC m=+5.559585695" watchObservedRunningTime="2026-07-13 23:39:49.621304272 +0000 UTC m=+22.589000123" Jul 13 23:39:49.621847 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.621795 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vs9qk" podStartSLOduration=3.711077936 podStartE2EDuration="22.621783497s" totalImagesPullingTime="18.910705561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:49.621433559 +0000 UTC m=+22.589129410" watchObservedRunningTime="2026-07-13 23:39:49.621783497 +0000 UTC m=+22.589479347" Jul 13 23:39:49.635064 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.635015 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kmrss" podStartSLOduration=8.223341383 podStartE2EDuration="22.634996448s" totalImagesPullingTime="14.411655065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:49.63432743 +0000 UTC m=+22.602023280" watchObservedRunningTime="2026-07-13 23:39:49.634996448 +0000 UTC m=+22.602692298" Jul 13 23:39:49.652861 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.652654 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8wgn2" podStartSLOduration=3.692474439 podStartE2EDuration="22.652635237s" totalImagesPullingTime="18.960160798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:49.649352833 +0000 UTC m=+22.617048688" watchObservedRunningTime="2026-07-13 23:39:49.652635237 +0000 UTC m=+22.620331089" Jul 13 23:39:49.665602 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.665554 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nvn8n" podStartSLOduration=3.715188458 podStartE2EDuration="22.665539562s" totalImagesPullingTime="18.950351104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:49.665302285 +0000 UTC m=+22.632998136" watchObservedRunningTime="2026-07-13 23:39:49.665539562 +0000 UTC m=+22.633235411" Jul 13 23:39:49.680762 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.680710 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gscfc" podStartSLOduration=3.736378691 podStartE2EDuration="22.680690521s" totalImagesPullingTime="18.94431183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:49.680002426 +0000 UTC m=+22.647698275" watchObservedRunningTime="2026-07-13 23:39:49.680690521 +0000 UTC m=+22.648386372" Jul 13 23:39:49.799250 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.799219 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:49.873788 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:49.873764 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:50.190457 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.190211 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:50.190961 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.190942 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:50.509924 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.509894 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:50.510140 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.509903 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:50.510140 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:50.510020 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:50.510140 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:50.510085 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:50.624338 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.624311 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:39:50.625286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.624717 2557 generic.go:356] "Generic (PLEG): container finished" podID="dad32e11-f8f3-44f3-87a1-6c03fdd26a76" containerID="c54df0cfb4bd28d63092d0937bd71a03798b14b49c6ae05172e25f7205bfe714" exitCode=1 Jul 13 23:39:50.625286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.624781 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"525929c8a56bf90ae7521454ce1dbe327d7b6a17a2d9d94c7fef6ecbb05d83ce"} Jul 13 23:39:50.625286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.624889 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"0c8ec157824ba4e962c2740f161001ffbbe710936b10e827b73c050b3aa52e7e"} Jul 13 23:39:50.625628 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.625606 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:50.625692 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.625650 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"0bbe4e6280c24cede3643c0f9c82de7a6b19dbd4013070958712609ba7842fc5"} Jul 13 23:39:50.625743 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.625708 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"99358308f4393914587969bfef2a02a381f6867e9ce70fcdb5e28478c4353d86"} Jul 13 23:39:50.625794 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.625757 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerDied","Data":"c54df0cfb4bd28d63092d0937bd71a03798b14b49c6ae05172e25f7205bfe714"} Jul 13 23:39:50.625876 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.625859 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kmrss" Jul 13 23:39:50.626006 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.625882 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"2bcd0733d3a2a782cc5637c76439a37e5e83d6c4be6d3ad147d8a555474e9a6b"} Jul 13 23:39:50.682092 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.679697 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:50.836649 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:50.836624 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 23:39:51.434472 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.434311 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T23:39:50.836645957Z","UUID":"3ea42a16-340e-4088-a502-654ba9352830","Handler":null,"Name":"","Endpoint":""} Jul 13 23:39:51.436010 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.435965 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 23:39:51.436010 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.436001 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 23:39:51.510178 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.510147 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:51.510349 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:51.510294 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:51.629871 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.629832 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" event={"ID":"6dfd3cba-c98c-4384-8c99-20fc006ed9cd","Type":"ContainerStarted","Data":"81b9019168970c16337703769d0fc3f5785335d0c31f115112bf2d5ec77944cb"} Jul 13 23:39:51.631907 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.631879 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gtz8q" event={"ID":"f571c1e3-d0e3-49a7-9afb-75e2e7256724","Type":"ContainerStarted","Data":"25c34ffcac878d6f43afb4e952f9acccf58d8d45fe2f8df061e04285f0409f3b"} Jul 13 23:39:51.646476 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.646423 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gtz8q" podStartSLOduration=5.699299052 podStartE2EDuration="24.646403972s" totalImagesPullingTime="18.94710492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:51.646128852 +0000 UTC m=+24.613824702" watchObservedRunningTime="2026-07-13 23:39:51.646403972 +0000 UTC m=+24.614099823" Jul 13 23:39:51.672869 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.672836 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:51.763542 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.763453 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:51.862946 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:51.862919 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:52.510688 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:52.510394 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:52.510946 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:52.510414 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:52.510946 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:52.510759 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:52.510946 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:52.510834 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:52.636697 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:52.636644 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" event={"ID":"6dfd3cba-c98c-4384-8c99-20fc006ed9cd","Type":"ContainerStarted","Data":"8bbbb08c555ff8b97e6d316c201e708dd5564db64dd5b37696eeb8e256f7fbaf"} Jul 13 23:39:52.653024 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:52.652982 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbmkx" podStartSLOduration=4.496974336 podStartE2EDuration="25.652966734s" totalImagesPullingTime="21.155992398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:52.652612579 +0000 UTC m=+25.620308432" watchObservedRunningTime="2026-07-13 23:39:52.652966734 +0000 UTC m=+25.620662587" Jul 13 23:39:53.509838 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:53.509800 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:53.510012 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:53.509940 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:53.765837 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:53.765751 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:53.820415 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:53.820383 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:53.931075 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:53.931048 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:54.033903 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.033879 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:54.171837 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.171789 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:54.223185 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.223155 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:54.402098 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.402030 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:54.469234 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.469204 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:54.510384 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.510360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:54.510571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.510403 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:54.510571 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:54.510482 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:54.510681 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:54.510587 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:54.521254 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.521229 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:54.638969 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.638940 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:54.644815 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.644781 2557 generic.go:356] "Generic (PLEG): container finished" podID="219c1d5e-bc7c-4608-816e-982173569fa7" containerID="e6246db14bebbea81f1990ec8e9deac5e0c2e524fb81d99d39c4a828488b2c84" exitCode=0 Jul 13 23:39:54.644948 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.644854 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snlc4" event={"ID":"219c1d5e-bc7c-4608-816e-982173569fa7","Type":"ContainerDied","Data":"e6246db14bebbea81f1990ec8e9deac5e0c2e524fb81d99d39c4a828488b2c84"} Jul 13 23:39:54.647717 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.647701 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:39:54.648045 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.648021 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"8d5294b6c13043c8d493d21c2c77934174c999ba99893a86d2528c199042738a"} Jul 13 23:39:54.740351 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:54.740282 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:55.510464 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:55.510437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:55.511043 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:55.510534 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:55.528657 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:55.528633 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vs9qk_f6627cc2-5cf1-44ff-af0d-7ad75a669105/dns-node-resolver/0.log" Jul 13 23:39:56.129857 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.129591 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gscfc_69b77072-2f31-4b3b-9411-c3647d1d2b90/node-ca/0.log" Jul 13 23:39:56.341527 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.341493 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:56.510201 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.510136 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:56.510338 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:56.510232 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:56.510338 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.510292 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:56.510407 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:56.510384 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:56.654167 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.654135 2557 generic.go:356] "Generic (PLEG): container finished" podID="219c1d5e-bc7c-4608-816e-982173569fa7" containerID="13d0187ab3122d3b0da6b3fa0bab81d06cc6dccfd4e709a85e65e3422c8d62e8" exitCode=0 Jul 13 23:39:56.654712 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.654215 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snlc4" event={"ID":"219c1d5e-bc7c-4608-816e-982173569fa7","Type":"ContainerDied","Data":"13d0187ab3122d3b0da6b3fa0bab81d06cc6dccfd4e709a85e65e3422c8d62e8"} Jul 13 23:39:56.657834 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.657801 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:39:56.658175 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.658154 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"a39041d00054eb1b5e8d3708332a886578a2d95d730f03423f3555545ad067c7"} Jul 13 23:39:56.658454 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.658438 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:56.658515 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.658498 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:56.658637 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.658625 2557 scope.go:117] "RemoveContainer" containerID="c54df0cfb4bd28d63092d0937bd71a03798b14b49c6ae05172e25f7205bfe714" Jul 13 23:39:56.676113 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.676095 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:56.841776 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.841750 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:56.898991 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:56.898967 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:57.122973 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.122894 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:57.223706 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.223677 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:57.510512 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.510446 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:57.510631 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:57.510534 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:57.665432 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.665411 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:39:57.665812 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.665786 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" event={"ID":"dad32e11-f8f3-44f3-87a1-6c03fdd26a76","Type":"ContainerStarted","Data":"48229fe4a7038bf7cdb8eb0fd71ceded88dfda51d92f546ad8fb644cc98b6db7"} Jul 13 23:39:57.666209 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.666014 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:57.684705 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.684683 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:39:57.696725 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.696689 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" podStartSLOduration=11.578161647 podStartE2EDuration="30.696675033s" totalImagesPullingTime="19.118513386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:39:57.69500253 +0000 UTC m=+30.662698380" watchObservedRunningTime="2026-07-13 23:39:57.696675033 +0000 UTC m=+30.664370903" Jul 13 23:39:57.990996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.990781 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vtl5"] Jul 13 23:39:57.991137 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.991113 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:57.991226 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:57.991205 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:57.994136 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.994109 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j5fqw"] Jul 13 23:39:57.994249 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.994209 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:57.994314 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:57.994291 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:57.995006 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.994973 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mbbz9"] Jul 13 23:39:57.995091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:57.995079 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:57.995205 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:57.995184 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:58.670123 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:58.670093 2557 generic.go:356] "Generic (PLEG): container finished" podID="219c1d5e-bc7c-4608-816e-982173569fa7" containerID="c4a6c257e985ecd14d567b436f64d1cebdbca063b496d573eb7954fdd0bd303d" exitCode=0 Jul 13 23:39:58.670596 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:58.670162 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snlc4" event={"ID":"219c1d5e-bc7c-4608-816e-982173569fa7","Type":"ContainerDied","Data":"c4a6c257e985ecd14d567b436f64d1cebdbca063b496d573eb7954fdd0bd303d"} Jul 13 23:39:59.510395 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:59.510362 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:39:59.510585 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:59.510409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:39:59.510585 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:59.510365 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:39:59.510585 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:59.510503 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:39:59.510744 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:59.510584 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:39:59.510744 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:39:59.510677 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:39:59.832109 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:59.832057 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:39:59.932335 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:39:59.932306 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:00.032877 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:00.032763 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:00.132650 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:00.132611 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:00.192260 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:00.192228 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:00.731603 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:00.731555 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:01.130700 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.130662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:01.131161 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.130712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:01.131161 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.130846 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 23:40:01.131161 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.130852 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:40:01.131161 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.130904 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret podName:6bcab85d-5d09-44f9-906a-f2a1a9455253 nodeName:}" failed. No retries permitted until 2026-07-13 23:40:33.130887318 +0000 UTC m=+66.098583149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret") pod "global-pull-secret-syncer-5vtl5" (UID: "6bcab85d-5d09-44f9-906a-f2a1a9455253") : object "kube-system"/"original-pull-secret" not registered Jul 13 23:40:01.131161 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.130926 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs podName:a062baa3-3416-400c-8bad-dd6c9379758e nodeName:}" failed. No retries permitted until 2026-07-13 23:40:33.130917634 +0000 UTC m=+66.098613466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs") pod "network-metrics-daemon-mbbz9" (UID: "a062baa3-3416-400c-8bad-dd6c9379758e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 23:40:01.231269 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.231237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:01.231429 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.231414 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 23:40:01.231489 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.231439 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 23:40:01.231489 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.231448 2557 projected.go:196] Error preparing data for projected volume kube-api-access-p9gvj for pod openshift-network-diagnostics/network-check-target-j5fqw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:40:01.231580 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.231503 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj podName:0682b2bb-d5b8-462f-80cf-a45595cd7ed1 nodeName:}" failed. No retries permitted until 2026-07-13 23:40:33.231485754 +0000 UTC m=+66.199181598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9gvj" (UniqueName: "kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj") pod "network-check-target-j5fqw" (UID: "0682b2bb-d5b8-462f-80cf-a45595cd7ed1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 23:40:01.510120 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.510034 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:01.510268 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.510041 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:01.510268 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.510161 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:40:01.510268 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.510172 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:01.510415 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.510293 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:40:01.510451 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:01.510413 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:40:01.565971 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.565939 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:01.720282 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.720252 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:01.860567 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.860526 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:01.961510 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:01.961471 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:02.135803 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:02.135707 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:02.331587 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:02.331560 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:02.525869 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:02.524434 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:02.682487 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:02.682459 2557 generic.go:356] "Generic (PLEG): container finished" podID="219c1d5e-bc7c-4608-816e-982173569fa7" containerID="d0bbec77aeb0010c4168941343306ddcac5d5d9d9922b104d0992abeee044299" exitCode=0 Jul 13 23:40:02.682585 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:02.682517 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snlc4" event={"ID":"219c1d5e-bc7c-4608-816e-982173569fa7","Type":"ContainerDied","Data":"d0bbec77aeb0010c4168941343306ddcac5d5d9d9922b104d0992abeee044299"} Jul 13 23:40:03.358078 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.358047 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:03.458697 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.458667 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:03.509849 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.509809 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:03.509973 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.509855 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:03.509973 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.509833 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:03.509973 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:03.509938 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:40:03.510130 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:03.510002 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:40:03.510130 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:03.510056 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:40:03.558490 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.558461 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:03.659586 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.659510 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:03.687983 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.687958 2557 generic.go:356] "Generic (PLEG): container finished" podID="219c1d5e-bc7c-4608-816e-982173569fa7" containerID="4d931fdddee863e7095fbf8623ba98840102345abe8430a39c4aad0fb7a0fd4f" exitCode=0 Jul 13 23:40:03.688093 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.688010 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snlc4" event={"ID":"219c1d5e-bc7c-4608-816e-982173569fa7","Type":"ContainerDied","Data":"4d931fdddee863e7095fbf8623ba98840102345abe8430a39c4aad0fb7a0fd4f"} Jul 13 23:40:03.927367 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:03.927282 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:04.129135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:04.129099 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:04.321345 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:04.321305 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:04.693594 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:04.693518 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snlc4" event={"ID":"219c1d5e-bc7c-4608-816e-982173569fa7","Type":"ContainerStarted","Data":"635c1be54f729c1b1c6e59685610e7e52fe36059c6aa9d6bf0b09e59547c627c"} Jul 13 23:40:04.715209 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:04.715164 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-snlc4" podStartSLOduration=8.448433998 podStartE2EDuration="37.715147433s" totalImagesPullingTime="29.266713435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:04.715136595 +0000 UTC m=+37.682832444" watchObservedRunningTime="2026-07-13 23:40:04.715147433 +0000 UTC m=+37.682843281" Jul 13 23:40:04.721514 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:04.721488 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:05.061496 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.061474 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:05.161401 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.161374 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:05.262055 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.262017 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:05.363345 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.363243 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:05.462801 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.462776 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:05.510025 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.509999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:05.510025 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.510030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:05.510243 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.509999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:05.510243 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:05.510119 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:40:05.510243 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:05.510169 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:40:05.510243 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:05.510236 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:40:05.563655 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.563628 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:05.906905 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.906868 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:05.956153 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:05.956130 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:06.031799 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:06.031778 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:06.132382 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:06.132348 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:06.233195 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:06.233117 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:06.333885 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:06.333717 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:06.433470 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:06.433443 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:06.711675 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:06.711646 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:06.767275 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:06.767245 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:06.918714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:06.918672 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:07.125343 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:07.125312 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:07.511093 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:07.511016 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:07.511238 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:07.511101 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:40:07.511238 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:07.511189 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:07.511316 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:07.511276 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:07.511349 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:07.511313 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:40:07.511349 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:07.511337 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:40:07.927487 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:07.927459 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:08.027694 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:08.027660 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:08.082789 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:08.082752 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:08.139265 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:08.139231 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:08.280076 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:08.279985 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:08.614774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:08.614734 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:08.724732 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:08.724703 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:09.323926 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:09.323891 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:09.510592 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:09.510559 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:09.510778 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:09.510679 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:09.510778 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:09.510692 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:09.510778 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:09.510688 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:40:09.510963 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:09.510773 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:40:09.510963 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:09.510863 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:40:09.732999 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:09.732901 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:09.928038 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:09.928005 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:10.524955 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:10.524922 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:10.728221 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:10.728183 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:10.922742 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:10.922710 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:11.510640 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:11.510606 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:11.510640 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:11.510632 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:11.510886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:11.510609 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:11.510886 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:11.510718 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:40:11.510886 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:11.510790 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:40:11.510886 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:11.510876 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:40:13.510118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:13.510085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:13.510584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:13.510091 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:13.510584 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:13.510195 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:40:13.510584 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:13.510291 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:40:13.510584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:13.510337 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:13.510584 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:13.510416 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:40:15.510174 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:15.510141 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:15.510574 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:15.510141 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:15.510574 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:15.510283 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:15.510574 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:15.510270 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbbz9" podUID="a062baa3-3416-400c-8bad-dd6c9379758e" Jul 13 23:40:15.510574 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:15.510357 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vtl5" podUID="6bcab85d-5d09-44f9-906a-f2a1a9455253" Jul 13 23:40:15.510574 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:15.510420 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5fqw" podUID="0682b2bb-d5b8-462f-80cf-a45595cd7ed1" Jul 13 23:40:15.964614 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:15.964581 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:16.100281 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:16.100240 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:16.191899 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:16.191866 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:16.280974 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:16.280900 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:16.902643 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:16.902618 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:16.961929 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:16.961905 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:17.296521 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.296450 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:17.330608 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.330584 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-62.ec2.internal" event="NodeReady" Jul 13 23:40:17.330737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.330708 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 23:40:17.375292 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.375261 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rklhs"] Jul 13 23:40:17.378623 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.378591 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:17.398843 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.398806 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lrxjb"] Jul 13 23:40:17.398943 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.398911 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.401629 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.401606 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 23:40:17.402011 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.401989 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 23:40:17.402107 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.401989 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zw85q\"" Jul 13 23:40:17.407017 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.407000 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rklhs"] Jul 13 23:40:17.407085 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.407034 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lrxjb"] Jul 13 23:40:17.407122 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.407100 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lrxjb" Jul 13 23:40:17.409358 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.409341 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b7hbx\"" Jul 13 23:40:17.409530 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.409513 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 23:40:17.409597 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.409516 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 23:40:17.409674 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.409658 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 23:40:17.456815 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.456785 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12fca644-415a-4c91-a463-22117539941b-tmp-dir\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.456815 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.456815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg645\" (UniqueName: \"kubernetes.io/projected/474181f5-67e9-4645-aa60-cfef7b205721-kube-api-access-tg645\") pod \"ingress-canary-lrxjb\" (UID: \"474181f5-67e9-4645-aa60-cfef7b205721\") " pod="openshift-ingress-canary/ingress-canary-lrxjb" Jul 13 23:40:17.457031 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.456881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7b96\" (UniqueName: \"kubernetes.io/projected/12fca644-415a-4c91-a463-22117539941b-kube-api-access-b7b96\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.457031 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.456898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/474181f5-67e9-4645-aa60-cfef7b205721-cert\") pod \"ingress-canary-lrxjb\" (UID: \"474181f5-67e9-4645-aa60-cfef7b205721\") " pod="openshift-ingress-canary/ingress-canary-lrxjb" Jul 13 23:40:17.457031 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.456917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12fca644-415a-4c91-a463-22117539941b-metrics-tls\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.457031 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.456980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12fca644-415a-4c91-a463-22117539941b-config-volume\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.477696 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.477669 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rtkb2"] Jul 13 23:40:17.488567 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.488547 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.491134 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.491107 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 23:40:17.491241 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.491146 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 23:40:17.491241 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.491163 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 23:40:17.491241 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.491162 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9c6sz\"" Jul 13 23:40:17.491401 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.491373 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 23:40:17.493309 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.493273 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rtkb2"] Jul 13 23:40:17.511998 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.511974 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:17.512094 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.512060 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:17.512139 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.512099 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:17.514780 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.514761 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 23:40:17.514879 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.514793 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5s29d\"" Jul 13 23:40:17.514879 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.514868 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 23:40:17.514879 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.514877 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 23:40:17.515027 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.514989 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 23:40:17.516063 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.516022 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qp66b\"" Jul 13 23:40:17.516391 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.516373 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:17.557928 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.557861 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/474181f5-67e9-4645-aa60-cfef7b205721-cert\") pod \"ingress-canary-lrxjb\" (UID: \"474181f5-67e9-4645-aa60-cfef7b205721\") " pod="openshift-ingress-canary/ingress-canary-lrxjb" Jul 13 23:40:17.557928 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.557894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12fca644-415a-4c91-a463-22117539941b-metrics-tls\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.557928 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.557917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9398136e-98f7-40c8-b579-bf968ff72c82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.558169 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.557939 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12fca644-415a-4c91-a463-22117539941b-config-volume\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.558169 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.557958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9398136e-98f7-40c8-b579-bf968ff72c82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.558169 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.558088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9398136e-98f7-40c8-b579-bf968ff72c82-crio-socket\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.558169 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.558141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9398136e-98f7-40c8-b579-bf968ff72c82-data-volume\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.558169 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.558169 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lt5x\" (UniqueName: \"kubernetes.io/projected/9398136e-98f7-40c8-b579-bf968ff72c82-kube-api-access-7lt5x\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.558405 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.558229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12fca644-415a-4c91-a463-22117539941b-tmp-dir\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.558405 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.558255 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg645\" (UniqueName: \"kubernetes.io/projected/474181f5-67e9-4645-aa60-cfef7b205721-kube-api-access-tg645\") pod \"ingress-canary-lrxjb\" (UID: \"474181f5-67e9-4645-aa60-cfef7b205721\") " pod="openshift-ingress-canary/ingress-canary-lrxjb" Jul 13 23:40:17.558510 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.558466 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12fca644-415a-4c91-a463-22117539941b-tmp-dir\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.558563 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.558517 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7b96\" (UniqueName: \"kubernetes.io/projected/12fca644-415a-4c91-a463-22117539941b-kube-api-access-b7b96\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.558707 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.558687 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12fca644-415a-4c91-a463-22117539941b-config-volume\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.561794 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.561774 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12fca644-415a-4c91-a463-22117539941b-metrics-tls\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.562025 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.562007 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/474181f5-67e9-4645-aa60-cfef7b205721-cert\") pod \"ingress-canary-lrxjb\" (UID: \"474181f5-67e9-4645-aa60-cfef7b205721\") " pod="openshift-ingress-canary/ingress-canary-lrxjb" Jul 13 23:40:17.568273 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.568243 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg645\" (UniqueName: \"kubernetes.io/projected/474181f5-67e9-4645-aa60-cfef7b205721-kube-api-access-tg645\") pod \"ingress-canary-lrxjb\" (UID: \"474181f5-67e9-4645-aa60-cfef7b205721\") " pod="openshift-ingress-canary/ingress-canary-lrxjb" Jul 13 23:40:17.568382 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.568360 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7b96\" (UniqueName: \"kubernetes.io/projected/12fca644-415a-4c91-a463-22117539941b-kube-api-access-b7b96\") pod \"dns-default-rklhs\" (UID: \"12fca644-415a-4c91-a463-22117539941b\") " pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.584629 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.584607 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:17.643013 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.642982 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:17.658968 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.658938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9398136e-98f7-40c8-b579-bf968ff72c82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.659117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.658975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9398136e-98f7-40c8-b579-bf968ff72c82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.659117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.659076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9398136e-98f7-40c8-b579-bf968ff72c82-crio-socket\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.659232 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.659218 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9398136e-98f7-40c8-b579-bf968ff72c82-crio-socket\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.659288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.659225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9398136e-98f7-40c8-b579-bf968ff72c82-data-volume\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.659288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.659261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lt5x\" (UniqueName: \"kubernetes.io/projected/9398136e-98f7-40c8-b579-bf968ff72c82-kube-api-access-7lt5x\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.659526 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.659507 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9398136e-98f7-40c8-b579-bf968ff72c82-data-volume\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.659601 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.659576 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9398136e-98f7-40c8-b579-bf968ff72c82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.661323 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.661301 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9398136e-98f7-40c8-b579-bf968ff72c82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.670646 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.670625 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lt5x\" (UniqueName: \"kubernetes.io/projected/9398136e-98f7-40c8-b579-bf968ff72c82-kube-api-access-7lt5x\") pod \"insights-runtime-extractor-rtkb2\" (UID: \"9398136e-98f7-40c8-b579-bf968ff72c82\") " pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.707628 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.707605 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:17.714716 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.714696 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lrxjb" Jul 13 23:40:17.799910 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.799370 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rtkb2" Jul 13 23:40:17.897506 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.897476 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lrxjb"] Jul 13 23:40:17.903570 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:17.903286 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474181f5_67e9_4645_aa60_cfef7b205721.slice/crio-fd2553bd67aecc61f2f405c04ce8b6e441165f6eba75e02d6689cd16c22f6e90 WatchSource:0}: Error finding container fd2553bd67aecc61f2f405c04ce8b6e441165f6eba75e02d6689cd16c22f6e90: Status 404 returned error can't find the container with id fd2553bd67aecc61f2f405c04ce8b6e441165f6eba75e02d6689cd16c22f6e90 Jul 13 23:40:17.904602 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.904578 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rklhs"] Jul 13 23:40:17.909627 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:17.909602 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fca644_415a_4c91_a463_22117539941b.slice/crio-77a8c2b314acf9f697a637f15e19e669da586633cd05cd1b6f9ba9e180ff305b WatchSource:0}: Error finding container 77a8c2b314acf9f697a637f15e19e669da586633cd05cd1b6f9ba9e180ff305b: Status 404 returned error can't find the container with id 77a8c2b314acf9f697a637f15e19e669da586633cd05cd1b6f9ba9e180ff305b Jul 13 23:40:17.961076 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:17.961044 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rtkb2"] Jul 13 23:40:17.964698 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:17.964673 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9398136e_98f7_40c8_b579_bf968ff72c82.slice/crio-62b6bcf31c983bf479c3a494d126fae7705ecf4ed2cc7dadacaea17b8da55811 WatchSource:0}: Error finding container 62b6bcf31c983bf479c3a494d126fae7705ecf4ed2cc7dadacaea17b8da55811: Status 404 returned error can't find the container with id 62b6bcf31c983bf479c3a494d126fae7705ecf4ed2cc7dadacaea17b8da55811 Jul 13 23:40:18.096187 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:18.096104 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:18.357311 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:18.357237 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:18.472117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:18.472035 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:18.553802 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:18.553756 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:18.724449 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:18.724316 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rtkb2" event={"ID":"9398136e-98f7-40c8-b579-bf968ff72c82","Type":"ContainerStarted","Data":"62b6bcf31c983bf479c3a494d126fae7705ecf4ed2cc7dadacaea17b8da55811"} Jul 13 23:40:18.725793 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:18.725734 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rklhs" event={"ID":"12fca644-415a-4c91-a463-22117539941b","Type":"ContainerStarted","Data":"77a8c2b314acf9f697a637f15e19e669da586633cd05cd1b6f9ba9e180ff305b"} Jul 13 23:40:18.727464 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:18.727443 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lrxjb" event={"ID":"474181f5-67e9-4645-aa60-cfef7b205721","Type":"ContainerStarted","Data":"fd2553bd67aecc61f2f405c04ce8b6e441165f6eba75e02d6689cd16c22f6e90"} Jul 13 23:40:19.292539 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:19.292492 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:19.393681 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:19.393648 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:19.692278 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:19.692209 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:19.743981 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:19.743912 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:22.763701 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.763619 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-546b4c79b-kgq2x"] Jul 13 23:40:22.770204 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.770181 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.774433 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.774407 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 23:40:22.774554 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.774523 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 23:40:22.774554 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.774533 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 23:40:22.774882 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.774860 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 23:40:22.775864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.775809 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 23:40:22.775864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.775847 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 23:40:22.776023 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.775906 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5frwb\"" Jul 13 23:40:22.776023 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.775960 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 23:40:22.779368 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.779342 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-546b4c79b-kgq2x"] Jul 13 23:40:22.804720 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.804695 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-serving-cert\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.804877 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.804749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-oauth-config\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.804877 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.804810 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lfg6\" (UniqueName: \"kubernetes.io/projected/f307bfa2-311b-41f7-8154-a148b0819adc-kube-api-access-8lfg6\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.805000 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.804888 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-service-ca\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.805000 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.804941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-console-config\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.805095 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.805007 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-oauth-serving-cert\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.905356 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.905322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-oauth-config\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.905356 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.905361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lfg6\" (UniqueName: \"kubernetes.io/projected/f307bfa2-311b-41f7-8154-a148b0819adc-kube-api-access-8lfg6\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.905594 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.905378 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-service-ca\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.905594 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.905408 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-console-config\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.905594 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.905460 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-oauth-serving-cert\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.905594 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.905499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-serving-cert\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.906201 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.906147 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-service-ca\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.906310 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.906270 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-console-config\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.906310 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.906283 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-oauth-serving-cert\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.908054 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.908034 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-oauth-config\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.908141 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.908125 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-serving-cert\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.917399 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.917377 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lfg6\" (UniqueName: \"kubernetes.io/projected/f307bfa2-311b-41f7-8154-a148b0819adc-kube-api-access-8lfg6\") pod \"console-546b4c79b-kgq2x\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:22.980725 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:22.980680 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:23.080245 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.080206 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:23.082142 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.082117 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:23.129259 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.129225 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75"] Jul 13 23:40:23.131447 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.131424 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" Jul 13 23:40:23.134280 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.134255 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 13 23:40:23.134466 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.134322 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8slkf\"" Jul 13 23:40:23.142407 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.142382 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75"] Jul 13 23:40:23.161542 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.161515 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:23.207625 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.207588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c9d6aaf-40ea-42cc-bee3-e44c28448953-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-xcs75\" (UID: \"3c9d6aaf-40ea-42cc-bee3-e44c28448953\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" Jul 13 23:40:23.308365 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.308330 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c9d6aaf-40ea-42cc-bee3-e44c28448953-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-xcs75\" (UID: \"3c9d6aaf-40ea-42cc-bee3-e44c28448953\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" Jul 13 23:40:23.308510 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:23.308461 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 13 23:40:23.308565 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:23.308543 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9d6aaf-40ea-42cc-bee3-e44c28448953-tls-certificates podName:3c9d6aaf-40ea-42cc-bee3-e44c28448953 nodeName:}" failed. No retries permitted until 2026-07-13 23:40:23.808524498 +0000 UTC m=+56.776220330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3c9d6aaf-40ea-42cc-bee3-e44c28448953-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-xcs75" (UID: "3c9d6aaf-40ea-42cc-bee3-e44c28448953") : secret "prometheus-operator-admission-webhook-tls" not found Jul 13 23:40:23.392342 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.392248 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:23.494020 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.493962 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:23.546211 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.544437 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-546b4c79b-kgq2x"] Jul 13 23:40:23.554279 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:23.553158 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf307bfa2_311b_41f7_8154_a148b0819adc.slice/crio-c0fc8c54a24851c10510e561b69ad4cc67af3151b9e7ceec82f5a4d2ee567c41 WatchSource:0}: Error finding container c0fc8c54a24851c10510e561b69ad4cc67af3151b9e7ceec82f5a4d2ee567c41: Status 404 returned error can't find the container with id c0fc8c54a24851c10510e561b69ad4cc67af3151b9e7ceec82f5a4d2ee567c41 Jul 13 23:40:23.691220 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.691116 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:23.744054 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.744015 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rklhs" event={"ID":"12fca644-415a-4c91-a463-22117539941b","Type":"ContainerStarted","Data":"f67cde9d1744f557aead60c6f5aa0ef4274b1f3e99b150cc9e32fd84798b94d8"} Jul 13 23:40:23.744240 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.744076 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rklhs" event={"ID":"12fca644-415a-4c91-a463-22117539941b","Type":"ContainerStarted","Data":"cf9663bd51fde508ba99a86052e023b94442489e8f346a601f3b49634ed9d72f"} Jul 13 23:40:23.744240 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.744105 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:23.745469 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.745437 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rtkb2" event={"ID":"9398136e-98f7-40c8-b579-bf968ff72c82","Type":"ContainerStarted","Data":"cd7b5c3ef2c04df523655eae6b16046d915d9c37bddd75dc25aeb5b5f03e116a"} Jul 13 23:40:23.746838 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.746796 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lrxjb" event={"ID":"474181f5-67e9-4645-aa60-cfef7b205721","Type":"ContainerStarted","Data":"094e6a6af2cd0b1e5957f2e81c93f2a0a5b73e097d0e6c6defa9d46084bd349c"} Jul 13 23:40:23.747961 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.747942 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-546b4c79b-kgq2x" event={"ID":"f307bfa2-311b-41f7-8154-a148b0819adc","Type":"ContainerStarted","Data":"c0fc8c54a24851c10510e561b69ad4cc67af3151b9e7ceec82f5a4d2ee567c41"} Jul 13 23:40:23.760810 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.760772 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rklhs" podStartSLOduration=1.26245074 podStartE2EDuration="6.760759224s" totalImagesPullingTime="5.498308484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:23.760044514 +0000 UTC m=+56.727740363" watchObservedRunningTime="2026-07-13 23:40:23.760759224 +0000 UTC m=+56.728455057" Jul 13 23:40:23.776239 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.776205 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lrxjb" podStartSLOduration=1.2727243480000001 podStartE2EDuration="6.77619702s" totalImagesPullingTime="5.503472672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:23.775988859 +0000 UTC m=+56.743684711" watchObservedRunningTime="2026-07-13 23:40:23.77619702 +0000 UTC m=+56.743892883" Jul 13 23:40:23.813584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.813555 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c9d6aaf-40ea-42cc-bee3-e44c28448953-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-xcs75\" (UID: \"3c9d6aaf-40ea-42cc-bee3-e44c28448953\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" Jul 13 23:40:23.815917 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:23.815888 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c9d6aaf-40ea-42cc-bee3-e44c28448953-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-xcs75\" (UID: \"3c9d6aaf-40ea-42cc-bee3-e44c28448953\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" Jul 13 23:40:24.036878 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:24.036852 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:24.041758 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:24.041737 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" Jul 13 23:40:24.137137 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:24.137111 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:24.162461 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:24.162295 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75"] Jul 13 23:40:24.164861 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:24.164835 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9d6aaf_40ea_42cc_bee3_e44c28448953.slice/crio-4fa29dc0268224ef261d49b05e1dc5d70d78898cb3e6dcf0b5d3fd4b88de9fa2 WatchSource:0}: Error finding container 4fa29dc0268224ef261d49b05e1dc5d70d78898cb3e6dcf0b5d3fd4b88de9fa2: Status 404 returned error can't find the container with id 4fa29dc0268224ef261d49b05e1dc5d70d78898cb3e6dcf0b5d3fd4b88de9fa2 Jul 13 23:40:24.755697 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:24.755615 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rtkb2" event={"ID":"9398136e-98f7-40c8-b579-bf968ff72c82","Type":"ContainerStarted","Data":"dff99ecdbc8c029a516ca7ea3a9f0f157deb003f4fd231941d06bc5506290518"} Jul 13 23:40:24.758413 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:24.758383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" event={"ID":"3c9d6aaf-40ea-42cc-bee3-e44c28448953","Type":"ContainerStarted","Data":"4fa29dc0268224ef261d49b05e1dc5d70d78898cb3e6dcf0b5d3fd4b88de9fa2"} Jul 13 23:40:25.137600 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:25.137524 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:25.236465 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:25.236431 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:25.762591 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:25.762548 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" event={"ID":"3c9d6aaf-40ea-42cc-bee3-e44c28448953","Type":"ContainerStarted","Data":"b62d1f087bf2a08ca9e0764630ec26e450cf3e0f868877bf48ca975820813449"} Jul 13 23:40:25.762840 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:25.762806 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" Jul 13 23:40:25.768264 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:25.768238 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" Jul 13 23:40:25.791510 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:25.791462 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-xcs75" podStartSLOduration=1.7126988829999998 podStartE2EDuration="2.791441999s" totalImagesPullingTime="1.078743116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:25.776968143 +0000 UTC m=+58.744664022" watchObservedRunningTime="2026-07-13 23:40:25.791441999 +0000 UTC m=+58.759137852" Jul 13 23:40:26.036657 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.036581 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:26.137046 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.137014 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:26.179369 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.179334 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-jb4w2"] Jul 13 23:40:26.186167 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.186135 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.189253 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.189220 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 13 23:40:26.189253 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.189230 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 23:40:26.189445 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.189278 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-g75kq\"" Jul 13 23:40:26.189445 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.189312 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 23:40:26.190048 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.190032 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 13 23:40:26.190154 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.190090 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 23:40:26.192843 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.192801 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-jb4w2"] Jul 13 23:40:26.202779 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.202754 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:26.237640 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.236581 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.237640 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.236669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.240795 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.240763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.241297 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.241272 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6bwd\" (UniqueName: \"kubernetes.io/projected/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-kube-api-access-p6bwd\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.342656 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.342605 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.342873 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.342694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.342873 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.342747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6bwd\" (UniqueName: \"kubernetes.io/projected/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-kube-api-access-p6bwd\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.342873 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.342794 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.343023 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:26.342917 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 13 23:40:26.343023 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:26.342985 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-tls podName:c91f5a09-3b59-4458-a1a7-bb248d2c94ca nodeName:}" failed. No retries permitted until 2026-07-13 23:40:26.842966132 +0000 UTC m=+59.810661965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-tls") pod "prometheus-operator-64785b6675-jb4w2" (UID: "c91f5a09-3b59-4458-a1a7-bb248d2c94ca") : secret "prometheus-operator-tls" not found Jul 13 23:40:26.343489 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.343463 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-metrics-client-ca\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.345284 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.345263 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.351842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.351801 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6bwd\" (UniqueName: \"kubernetes.io/projected/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-kube-api-access-p6bwd\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.388669 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.388636 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:26.849015 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.848965 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.851533 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.851504 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c91f5a09-3b59-4458-a1a7-bb248d2c94ca-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-jb4w2\" (UID: \"c91f5a09-3b59-4458-a1a7-bb248d2c94ca\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:26.942126 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.942084 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:26.991032 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:26.990991 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:27.096903 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.096867 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" Jul 13 23:40:27.330472 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.330438 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66dd5b49cd-jtq6v"] Jul 13 23:40:27.384615 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.384536 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dd5b49cd-jtq6v"] Jul 13 23:40:27.384757 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.384660 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.393774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.393749 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 23:40:27.454562 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.454503 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-serving-cert\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.454562 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.454558 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-trusted-ca-bundle\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.454773 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.454610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-oauth-config\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.455744 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.454634 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-config\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.455744 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.454926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-service-ca\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.455744 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.454979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2vhm\" (UniqueName: \"kubernetes.io/projected/4692afef-ba11-4f2d-9420-1204df0d5c5c-kube-api-access-k2vhm\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.455744 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.455029 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-oauth-serving-cert\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.556185 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.556143 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-oauth-serving-cert\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.556370 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.556305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-serving-cert\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.556370 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.556326 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-trusted-ca-bundle\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.556370 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.556349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-oauth-config\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.556370 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.556369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-config\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.556572 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.556399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-service-ca\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.556572 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.556439 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vhm\" (UniqueName: \"kubernetes.io/projected/4692afef-ba11-4f2d-9420-1204df0d5c5c-kube-api-access-k2vhm\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.556999 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.556969 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-oauth-serving-cert\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.557241 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.557193 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-config\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.557334 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.557266 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-trusted-ca-bundle\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.557741 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.557722 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-service-ca\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.559112 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.559093 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-oauth-config\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.559387 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.559364 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-serving-cert\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.566254 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.566234 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2vhm\" (UniqueName: \"kubernetes.io/projected/4692afef-ba11-4f2d-9420-1204df0d5c5c-kube-api-access-k2vhm\") pod \"console-66dd5b49cd-jtq6v\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:27.697040 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:27.696971 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:28.199802 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.199669 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-jb4w2"] Jul 13 23:40:28.202146 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:28.202116 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91f5a09_3b59_4458_a1a7_bb248d2c94ca.slice/crio-58d6de475b234fa09d30fdc2133c4a6cc739a6c4eb4f57da0ddacd69e1ccf2b9 WatchSource:0}: Error finding container 58d6de475b234fa09d30fdc2133c4a6cc739a6c4eb4f57da0ddacd69e1ccf2b9: Status 404 returned error can't find the container with id 58d6de475b234fa09d30fdc2133c4a6cc739a6c4eb4f57da0ddacd69e1ccf2b9 Jul 13 23:40:28.211505 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.211483 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dd5b49cd-jtq6v"] Jul 13 23:40:28.213975 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:28.213933 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4692afef_ba11_4f2d_9420_1204df0d5c5c.slice/crio-d3f07e00fce234b1755546cc10f51335c567a7d7e329c409aaa1f381144440a5 WatchSource:0}: Error finding container d3f07e00fce234b1755546cc10f51335c567a7d7e329c409aaa1f381144440a5: Status 404 returned error can't find the container with id d3f07e00fce234b1755546cc10f51335c567a7d7e329c409aaa1f381144440a5 Jul 13 23:40:28.774264 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.774228 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-546b4c79b-kgq2x" event={"ID":"f307bfa2-311b-41f7-8154-a148b0819adc","Type":"ContainerStarted","Data":"732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358"} Jul 13 23:40:28.774707 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.774426 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:28.776045 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.776016 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dd5b49cd-jtq6v" event={"ID":"4692afef-ba11-4f2d-9420-1204df0d5c5c","Type":"ContainerStarted","Data":"5f707138911dc85c85fc762d2677650c384d6d6e1a7ea07963f38aed15ec2e6d"} Jul 13 23:40:28.776169 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.776072 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dd5b49cd-jtq6v" event={"ID":"4692afef-ba11-4f2d-9420-1204df0d5c5c","Type":"ContainerStarted","Data":"d3f07e00fce234b1755546cc10f51335c567a7d7e329c409aaa1f381144440a5"} Jul 13 23:40:28.777376 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.777352 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" event={"ID":"c91f5a09-3b59-4458-a1a7-bb248d2c94ca","Type":"ContainerStarted","Data":"58d6de475b234fa09d30fdc2133c4a6cc739a6c4eb4f57da0ddacd69e1ccf2b9"} Jul 13 23:40:28.779683 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.779657 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rtkb2" event={"ID":"9398136e-98f7-40c8-b579-bf968ff72c82","Type":"ContainerStarted","Data":"5d5ae63b648d4bb71120b4489b412ba8be258ba80ec00cbfaa8224866052b30d"} Jul 13 23:40:28.792852 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.792792 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-546b4c79b-kgq2x" podStartSLOduration=2.2741064 podStartE2EDuration="6.792775193s" totalImagesPullingTime="4.518668793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:28.792485149 +0000 UTC m=+61.760181000" watchObservedRunningTime="2026-07-13 23:40:28.792775193 +0000 UTC m=+61.760471040" Jul 13 23:40:28.809996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.809927 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66dd5b49cd-jtq6v" podStartSLOduration=1.809910378 podStartE2EDuration="1.809910378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:28.808811286 +0000 UTC m=+61.776507136" watchObservedRunningTime="2026-07-13 23:40:28.809910378 +0000 UTC m=+61.777606226" Jul 13 23:40:28.825810 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.825762 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rtkb2" podStartSLOduration=1.851240177 podStartE2EDuration="11.825747002s" totalImagesPullingTime="9.974506825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:40:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:28.824777737 +0000 UTC m=+61.792473612" watchObservedRunningTime="2026-07-13 23:40:28.825747002 +0000 UTC m=+61.793442864" Jul 13 23:40:28.875357 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:28.875327 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:29.683452 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:29.683352 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:29.683612 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:29.683466 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd87m" Jul 13 23:40:29.785494 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:29.785463 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" event={"ID":"c91f5a09-3b59-4458-a1a7-bb248d2c94ca","Type":"ContainerStarted","Data":"ad84577c262d69a08c0b64920430a477a7ea0b1c4c83bdc74372f5c90263d30a"} Jul 13 23:40:29.785895 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:29.785513 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" event={"ID":"c91f5a09-3b59-4458-a1a7-bb248d2c94ca","Type":"ContainerStarted","Data":"46feb8a4ba6b9f024d1ad15cfb524b800659a5fb2cea969aa5a9186c7fb822e4"} Jul 13 23:40:29.804089 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:29.804048 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-jb4w2" podStartSLOduration=2.585538127 podStartE2EDuration="3.804032328s" totalImagesPullingTime="1.218494201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:29.803101347 +0000 UTC m=+62.770797197" watchObservedRunningTime="2026-07-13 23:40:29.804032328 +0000 UTC m=+62.771728177" Jul 13 23:40:29.804594 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:29.804575 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:29.901951 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:29.901923 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:30.015361 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:30.015279 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:30.881148 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:30.881121 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:31.303688 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.303606 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:31.514621 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.514593 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:31.540300 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.540266 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl"] Jul 13 23:40:31.542711 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.542693 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.545228 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.545205 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mh2rh\"" Jul 13 23:40:31.545312 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.545208 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 13 23:40:31.545566 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.545550 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 13 23:40:31.555814 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.555769 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl"] Jul 13 23:40:31.570769 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.570748 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kqbfm"] Jul 13 23:40:31.573009 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.572989 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.574212 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.574192 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8wtpb"] Jul 13 23:40:31.575722 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.575699 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r476t\"" Jul 13 23:40:31.575812 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.575723 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 13 23:40:31.575812 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.575727 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 13 23:40:31.575812 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.575741 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 13 23:40:31.576155 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.576139 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.580505 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.578468 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7b4pc\"" Jul 13 23:40:31.580505 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.578698 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 23:40:31.580505 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.578790 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 23:40:31.580505 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.578963 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 23:40:31.588545 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.588520 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kqbfm"] Jul 13 23:40:31.593467 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.593445 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m44q8\" (UniqueName: \"kubernetes.io/projected/b79e71cf-f56e-470e-beff-70e14bbd293a-kube-api-access-m44q8\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.593546 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.593493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.593546 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.593527 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.593546 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.593542 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b79e71cf-f56e-470e-beff-70e14bbd293a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.607762 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.607741 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:31.680859 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.680806 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:31.694342 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.694446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694350 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-textfile\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.694446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694373 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mx4l\" (UniqueName: \"kubernetes.io/projected/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-api-access-6mx4l\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.694446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694424 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-wtmp\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.694580 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694487 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-tls\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.694580 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694515 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-root\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.694580 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.694714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.694714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694613 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b79e71cf-f56e-470e-beff-70e14bbd293a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.694714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694635 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.694714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694666 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4mrt\" (UniqueName: \"kubernetes.io/projected/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-kube-api-access-g4mrt\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.694714 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:31.694681 2557 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 13 23:40:31.694714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.695018 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:31.694742 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-tls podName:b79e71cf-f56e-470e-beff-70e14bbd293a nodeName:}" failed. No retries permitted until 2026-07-13 23:40:32.19472331 +0000 UTC m=+65.162419141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-gcwdl" (UID: "b79e71cf-f56e-470e-beff-70e14bbd293a") : secret "openshift-state-metrics-tls" not found Jul 13 23:40:31.695018 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694764 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.695018 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694841 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.695018 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694869 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-sys\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.695018 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m44q8\" (UniqueName: \"kubernetes.io/projected/b79e71cf-f56e-470e-beff-70e14bbd293a-kube-api-access-m44q8\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.695018 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694939 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-metrics-client-ca\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.695018 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.694979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.695284 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.695049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.695315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.695282 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b79e71cf-f56e-470e-beff-70e14bbd293a-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.696740 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.696723 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.703237 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.703212 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m44q8\" (UniqueName: \"kubernetes.io/projected/b79e71cf-f56e-470e-beff-70e14bbd293a-kube-api-access-m44q8\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:31.784409 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.784373 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:31.795517 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.795517 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-textfile\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.795712 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795555 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mx4l\" (UniqueName: \"kubernetes.io/projected/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-api-access-6mx4l\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.795712 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-wtmp\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.795712 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795682 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-wtmp\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.795884 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795711 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-tls\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.795884 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795751 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-root\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.795884 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795788 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.795884 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795859 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.795884 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795869 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-root\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795893 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4mrt\" (UniqueName: \"kubernetes.io/projected/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-kube-api-access-g4mrt\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795902 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-textfile\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.796118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.795968 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.796118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796011 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.796118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-sys\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796063 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-metrics-client-ca\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796488 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796173 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.796488 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796196 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-sys\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796488 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796230 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.796488 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:31.796257 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 13 23:40:31.796488 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:31.796310 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-tls podName:1c25cf18-e2af-4413-bd8f-d61626d6f3a8 nodeName:}" failed. No retries permitted until 2026-07-13 23:40:32.296292805 +0000 UTC m=+65.263988641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-kqbfm" (UID: "1c25cf18-e2af-4413-bd8f-d61626d6f3a8") : secret "kube-state-metrics-tls" not found Jul 13 23:40:31.796795 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796485 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796795 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796782 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-metrics-client-ca\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.796889 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.796842 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.798172 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.798153 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-tls\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.798277 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.798258 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.798412 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.798395 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.806355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.806300 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mx4l\" (UniqueName: \"kubernetes.io/projected/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-api-access-6mx4l\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:31.806465 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.806403 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4mrt\" (UniqueName: \"kubernetes.io/projected/f5c509c4-3494-4e53-abd6-5d3989bd5c4f-kube-api-access-g4mrt\") pod \"node-exporter-8wtpb\" (UID: \"f5c509c4-3494-4e53-abd6-5d3989bd5c4f\") " pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.880587 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.880554 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:31.890741 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.890721 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8wtpb" Jul 13 23:40:31.900149 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:31.900119 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c509c4_3494_4e53_abd6_5d3989bd5c4f.slice/crio-c8815ccb95d9b183a90d1104ff34dd3c50fb8450903c67ea61d81051585e4cd0 WatchSource:0}: Error finding container c8815ccb95d9b183a90d1104ff34dd3c50fb8450903c67ea61d81051585e4cd0: Status 404 returned error can't find the container with id c8815ccb95d9b183a90d1104ff34dd3c50fb8450903c67ea61d81051585e4cd0 Jul 13 23:40:31.983301 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:31.983270 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:32.084148 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.084119 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:32.199564 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.199530 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:32.201777 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.201752 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b79e71cf-f56e-470e-beff-70e14bbd293a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-gcwdl\" (UID: \"b79e71cf-f56e-470e-beff-70e14bbd293a\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:32.245594 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.245570 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:32.300850 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.300803 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:32.303059 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.303034 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c25cf18-e2af-4413-bd8f-d61626d6f3a8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kqbfm\" (UID: \"1c25cf18-e2af-4413-bd8f-d61626d6f3a8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:32.452034 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.451957 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" Jul 13 23:40:32.485254 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.485228 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" Jul 13 23:40:32.512420 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.512175 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:32.598158 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.598114 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:32.603807 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.603564 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 23:40:32.609258 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.609229 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.612980 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.612783 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 23:40:32.613101 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.613090 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-f4s9r\"" Jul 13 23:40:32.613319 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.613282 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 23:40:32.613414 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.613323 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 23:40:32.613559 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.613525 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 23:40:32.613784 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.613767 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 23:40:32.613971 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.613782 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 23:40:32.613971 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.613909 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 23:40:32.614365 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.614343 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 23:40:32.614493 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.614474 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 23:40:32.624259 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.624238 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl"] Jul 13 23:40:32.627522 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:32.627494 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79e71cf_f56e_470e_beff_70e14bbd293a.slice/crio-0dae9580e3ac34a9315d52a47210aa1afa12b356bfa776066a4954cebd0c697f WatchSource:0}: Error finding container 0dae9580e3ac34a9315d52a47210aa1afa12b356bfa776066a4954cebd0c697f: Status 404 returned error can't find the container with id 0dae9580e3ac34a9315d52a47210aa1afa12b356bfa776066a4954cebd0c697f Jul 13 23:40:32.627676 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.627655 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 23:40:32.651721 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.651699 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kqbfm"] Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.708855 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.708904 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.708920 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.708936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.708957 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.708980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb6tq\" (UniqueName: \"kubernetes.io/projected/5add1f37-01b9-4d4c-afe0-960250fe22f4-kube-api-access-rb6tq\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.709000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5add1f37-01b9-4d4c-afe0-960250fe22f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.709017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.709032 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5add1f37-01b9-4d4c-afe0-960250fe22f4-config-out\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.709079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-web-config\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.709097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.709120 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.709289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.709134 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.725746 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.725711 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:32.798995 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.798956 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wtpb" event={"ID":"f5c509c4-3494-4e53-abd6-5d3989bd5c4f","Type":"ContainerStarted","Data":"c8815ccb95d9b183a90d1104ff34dd3c50fb8450903c67ea61d81051585e4cd0"} Jul 13 23:40:32.800896 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.800867 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" event={"ID":"b79e71cf-f56e-470e-beff-70e14bbd293a","Type":"ContainerStarted","Data":"573503c5e67ddb68bcbb56ee0814fd9e960a50dac95ff4ccae1c7605a63de41c"} Jul 13 23:40:32.801022 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.800933 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" event={"ID":"b79e71cf-f56e-470e-beff-70e14bbd293a","Type":"ContainerStarted","Data":"0dae9580e3ac34a9315d52a47210aa1afa12b356bfa776066a4954cebd0c697f"} Jul 13 23:40:32.810212 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810332 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810332 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810255 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810332 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810282 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810332 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb6tq\" (UniqueName: \"kubernetes.io/projected/5add1f37-01b9-4d4c-afe0-960250fe22f4-kube-api-access-rb6tq\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810332 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5add1f37-01b9-4d4c-afe0-960250fe22f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810583 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810643 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810590 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5add1f37-01b9-4d4c-afe0-960250fe22f4-config-out\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810709 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810684 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-web-config\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810773 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810773 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810756 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810890 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810763 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810946 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.810946 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:40:32.810925 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-trusted-ca-bundle podName:5add1f37-01b9-4d4c-afe0-960250fe22f4 nodeName:}" failed. No retries permitted until 2026-07-13 23:40:33.310906496 +0000 UTC m=+66.278602343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5add1f37-01b9-4d4c-afe0-960250fe22f4") : configmap references non-existent config key: ca-bundle.crt Jul 13 23:40:32.811054 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.810944 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.811636 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.811576 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.813548 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.813503 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5add1f37-01b9-4d4c-afe0-960250fe22f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.813687 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.813643 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.813775 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.813715 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.814492 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.814468 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-web-config\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.815101 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.815061 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.815206 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.815186 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.815267 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.815243 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.815440 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.815403 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5add1f37-01b9-4d4c-afe0-960250fe22f4-config-out\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.815890 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.815870 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5add1f37-01b9-4d4c-afe0-960250fe22f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.819043 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:32.819025 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb6tq\" (UniqueName: \"kubernetes.io/projected/5add1f37-01b9-4d4c-afe0-960250fe22f4-kube-api-access-rb6tq\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:32.860190 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:32.860167 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c25cf18_e2af_4413_bd8f_d61626d6f3a8.slice/crio-cf6d59c12872a2783936566eafbe4bc2812fe41aa3ec9db884d5a181e948dbbf WatchSource:0}: Error finding container cf6d59c12872a2783936566eafbe4bc2812fe41aa3ec9db884d5a181e948dbbf: Status 404 returned error can't find the container with id cf6d59c12872a2783936566eafbe4bc2812fe41aa3ec9db884d5a181e948dbbf Jul 13 23:40:33.082658 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.082625 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:33.083056 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.082724 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:33.087609 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.087588 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:33.214043 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.214010 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:33.214242 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.214085 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:33.217186 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.217156 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 23:40:33.217319 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.217208 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 23:40:33.227169 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.227144 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bcab85d-5d09-44f9-906a-f2a1a9455253-original-pull-secret\") pod \"global-pull-secret-syncer-5vtl5\" (UID: \"6bcab85d-5d09-44f9-906a-f2a1a9455253\") " pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:33.227296 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.227257 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a062baa3-3416-400c-8bad-dd6c9379758e-metrics-certs\") pod \"network-metrics-daemon-mbbz9\" (UID: \"a062baa3-3416-400c-8bad-dd6c9379758e\") " pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:33.315281 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.315249 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:33.315470 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.315362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:33.316104 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.316072 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5add1f37-01b9-4d4c-afe0-960250fe22f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5add1f37-01b9-4d4c-afe0-960250fe22f4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:33.318333 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.318304 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 23:40:33.328319 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.328294 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 23:40:33.339210 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.339187 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9gvj\" (UniqueName: \"kubernetes.io/projected/0682b2bb-d5b8-462f-80cf-a45595cd7ed1-kube-api-access-p9gvj\") pod \"network-check-target-j5fqw\" (UID: \"0682b2bb-d5b8-462f-80cf-a45595cd7ed1\") " pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:33.423806 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.423773 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qp66b\"" Jul 13 23:40:33.426928 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.426903 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vtl5" Jul 13 23:40:33.432106 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.432084 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:33.436186 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.436164 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5s29d\"" Jul 13 23:40:33.443715 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.443692 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbbz9" Jul 13 23:40:33.523469 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.523264 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 23:40:33.617288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.617199 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vtl5"] Jul 13 23:40:33.657541 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.656894 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j5fqw"] Jul 13 23:40:33.660934 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.660854 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mbbz9"] Jul 13 23:40:33.666097 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:33.666055 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda062baa3_3416_400c_8bad_dd6c9379758e.slice/crio-b70704612c74762f0588e9fddec8d5c74e98a4e17e01c197eee7420946003058 WatchSource:0}: Error finding container b70704612c74762f0588e9fddec8d5c74e98a4e17e01c197eee7420946003058: Status 404 returned error can't find the container with id b70704612c74762f0588e9fddec8d5c74e98a4e17e01c197eee7420946003058 Jul 13 23:40:33.726567 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.726525 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 23:40:33.730647 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:33.730606 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5add1f37_01b9_4d4c_afe0_960250fe22f4.slice/crio-59140ea086c88ba63e23249c99e50947ff52e12e0dbd353b7afcb7fbacce6964 WatchSource:0}: Error finding container 59140ea086c88ba63e23249c99e50947ff52e12e0dbd353b7afcb7fbacce6964: Status 404 returned error can't find the container with id 59140ea086c88ba63e23249c99e50947ff52e12e0dbd353b7afcb7fbacce6964 Jul 13 23:40:33.761409 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.761380 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rklhs" Jul 13 23:40:33.809792 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.809088 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbbz9" event={"ID":"a062baa3-3416-400c-8bad-dd6c9379758e","Type":"ContainerStarted","Data":"b70704612c74762f0588e9fddec8d5c74e98a4e17e01c197eee7420946003058"} Jul 13 23:40:33.812122 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.811243 2557 generic.go:356] "Generic (PLEG): container finished" podID="f5c509c4-3494-4e53-abd6-5d3989bd5c4f" containerID="e862e7b38027a1942b5ef3d506d9af173525c78786c7552d728f43e0c71cecf1" exitCode=0 Jul 13 23:40:33.812122 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.811315 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wtpb" event={"ID":"f5c509c4-3494-4e53-abd6-5d3989bd5c4f","Type":"ContainerDied","Data":"e862e7b38027a1942b5ef3d506d9af173525c78786c7552d728f43e0c71cecf1"} Jul 13 23:40:33.814739 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.814708 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j5fqw" event={"ID":"0682b2bb-d5b8-462f-80cf-a45595cd7ed1","Type":"ContainerStarted","Data":"5c7e4eb81857097515d419f64891dbc0d439dc4040536cad91efcb9180424105"} Jul 13 23:40:33.817046 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.816986 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vtl5" event={"ID":"6bcab85d-5d09-44f9-906a-f2a1a9455253","Type":"ContainerStarted","Data":"5e7ccbaf6026715c51b9458d66f9ad09774083d12b8929607b81be631bac6f79"} Jul 13 23:40:33.819222 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.819137 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" event={"ID":"b79e71cf-f56e-470e-beff-70e14bbd293a","Type":"ContainerStarted","Data":"4efae4db5803fa7af41d17364aa3677ee737c33841ae983c153fec5c43deb17a"} Jul 13 23:40:33.820592 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.820561 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5add1f37-01b9-4d4c-afe0-960250fe22f4","Type":"ContainerStarted","Data":"59140ea086c88ba63e23249c99e50947ff52e12e0dbd353b7afcb7fbacce6964"} Jul 13 23:40:33.821952 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.821892 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" event={"ID":"1c25cf18-e2af-4413-bd8f-d61626d6f3a8","Type":"ContainerStarted","Data":"cf6d59c12872a2783936566eafbe4bc2812fe41aa3ec9db884d5a181e948dbbf"} Jul 13 23:40:33.827156 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.827121 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:40:33.958313 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:33.958226 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:34.488330 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.488277 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:34.542040 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.542003 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-689769859f-v5spb"] Jul 13 23:40:34.560044 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.559969 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:34.563117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.563069 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-689769859f-v5spb"] Jul 13 23:40:34.563289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.563205 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.567851 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.567808 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 13 23:40:34.568327 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.568307 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 13 23:40:34.568619 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.568598 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 13 23:40:34.568727 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.568606 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6rtck\"" Jul 13 23:40:34.568789 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.568610 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 13 23:40:34.569092 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.569072 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ekju697oqcgl7\"" Jul 13 23:40:34.569191 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.569094 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 13 23:40:34.627687 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.627637 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.627885 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.627692 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.627885 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.627784 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-tls\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.627988 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.627892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.627988 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.627916 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-grpc-tls\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.627988 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.627938 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5dgn\" (UniqueName: \"kubernetes.io/projected/8eb20c2c-19d0-4c94-b01e-102229118f2b-kube-api-access-w5dgn\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.628107 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.627997 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.628107 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.628031 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb20c2c-19d0-4c94-b01e-102229118f2b-metrics-client-ca\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.728965 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.728925 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-tls\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.729145 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.729013 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.729145 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.729048 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-grpc-tls\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.729145 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.729076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dgn\" (UniqueName: \"kubernetes.io/projected/8eb20c2c-19d0-4c94-b01e-102229118f2b-kube-api-access-w5dgn\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.729145 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.729117 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.729145 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.729136 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb20c2c-19d0-4c94-b01e-102229118f2b-metrics-client-ca\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.729426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.729186 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.729426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.729215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.730856 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.730809 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb20c2c-19d0-4c94-b01e-102229118f2b-metrics-client-ca\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.733970 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.733462 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.733970 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.733500 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.733970 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.733922 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.734516 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.734473 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-grpc-tls\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.735246 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.735201 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.737535 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.737509 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8eb20c2c-19d0-4c94-b01e-102229118f2b-secret-thanos-querier-tls\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.738535 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.738483 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5dgn\" (UniqueName: \"kubernetes.io/projected/8eb20c2c-19d0-4c94-b01e-102229118f2b-kube-api-access-w5dgn\") pod \"thanos-querier-689769859f-v5spb\" (UID: \"8eb20c2c-19d0-4c94-b01e-102229118f2b\") " pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.827728 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.827696 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:34.875227 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.875171 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:34.926371 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:34.926306 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:35.116192 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.116164 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-689769859f-v5spb"] Jul 13 23:40:35.126776 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:35.124440 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb20c2c_19d0_4c94_b01e_102229118f2b.slice/crio-86c0eea0731d31ae911c137e38b6d38b7a3ae02fc80f13f6fbf16449dc5e894d WatchSource:0}: Error finding container 86c0eea0731d31ae911c137e38b6d38b7a3ae02fc80f13f6fbf16449dc5e894d: Status 404 returned error can't find the container with id 86c0eea0731d31ae911c137e38b6d38b7a3ae02fc80f13f6fbf16449dc5e894d Jul 13 23:40:35.163116 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.162590 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:35.263635 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.263564 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:35.845846 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.845784 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" event={"ID":"8eb20c2c-19d0-4c94-b01e-102229118f2b","Type":"ContainerStarted","Data":"86c0eea0731d31ae911c137e38b6d38b7a3ae02fc80f13f6fbf16449dc5e894d"} Jul 13 23:40:35.850342 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.850162 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fcc555d94-8wl78"] Jul 13 23:40:35.853038 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.853015 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wtpb" event={"ID":"f5c509c4-3494-4e53-abd6-5d3989bd5c4f","Type":"ContainerStarted","Data":"215a812fb7a1b88c0ee1c14eea01020214e3fcb9e20183ef94a2a53d196f6920"} Jul 13 23:40:35.853164 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.853068 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wtpb" event={"ID":"f5c509c4-3494-4e53-abd6-5d3989bd5c4f","Type":"ContainerStarted","Data":"7b8d01541bcecd837930fae4d1ebf2a881f59af5cffdf70bd79cee5ff586728a"} Jul 13 23:40:35.853164 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.853156 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:35.858862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.857291 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 23:40:35.858862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.857510 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6slmrmjm6n52r\"" Jul 13 23:40:35.858862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.857679 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 13 23:40:35.858862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.857860 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 13 23:40:35.858862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.858039 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 13 23:40:35.858862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.858246 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zcmfd\"" Jul 13 23:40:35.860105 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.860079 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" event={"ID":"b79e71cf-f56e-470e-beff-70e14bbd293a","Type":"ContainerStarted","Data":"e620e31f9c84478fcb1de5e8341b9b26996eb712baf8ad47fa1ec457ff7ee218"} Jul 13 23:40:35.862112 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.862064 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fcc555d94-8wl78"] Jul 13 23:40:35.863847 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.863694 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" event={"ID":"1c25cf18-e2af-4413-bd8f-d61626d6f3a8","Type":"ContainerStarted","Data":"67c3ec50a9ece1d5247fd77d90c4497bc8ee54c4bf60f82d3c9b67e16be6e3da"} Jul 13 23:40:35.863847 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.863752 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" event={"ID":"1c25cf18-e2af-4413-bd8f-d61626d6f3a8","Type":"ContainerStarted","Data":"f9cd79b5d7f9671f807dd57e77159159d5eab0e7aee34d5ac9b5d4e4df021d10"} Jul 13 23:40:35.863847 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.863785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" event={"ID":"1c25cf18-e2af-4413-bd8f-d61626d6f3a8","Type":"ContainerStarted","Data":"de2efede74db1e9af81fc17af395fb9f49cc9c6567717210710009f9d3d35433"} Jul 13 23:40:35.870992 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.870940 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8wtpb" podStartSLOduration=3.818446835 podStartE2EDuration="4.870921779s" totalImagesPullingTime="989.965666ms" totalInitContainerRuntime="62.509278ms" isStatefulPod=true podCreationTimestamp="2026-07-13 23:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:35.869799936 +0000 UTC m=+68.837495787" watchObservedRunningTime="2026-07-13 23:40:35.870921779 +0000 UTC m=+68.838617630" Jul 13 23:40:35.890792 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.890165 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-kqbfm" podStartSLOduration=2.958334242 podStartE2EDuration="4.890145107s" totalImagesPullingTime="1.931810865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:35.888844887 +0000 UTC m=+68.856540740" watchObservedRunningTime="2026-07-13 23:40:35.890145107 +0000 UTC m=+68.857840959" Jul 13 23:40:35.926288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.925088 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gcwdl" podStartSLOduration=3.048323891 podStartE2EDuration="4.925067845s" totalImagesPullingTime="1.876743954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:35.924180997 +0000 UTC m=+68.891876850" watchObservedRunningTime="2026-07-13 23:40:35.925067845 +0000 UTC m=+68.892763696" Jul 13 23:40:35.948620 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.948583 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f229cb40-f8c1-4b59-8b3c-a281d01937bc-metrics-server-audit-profiles\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:35.948764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.948728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrfb\" (UniqueName: \"kubernetes.io/projected/f229cb40-f8c1-4b59-8b3c-a281d01937bc-kube-api-access-fvrfb\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:35.948870 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.948761 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-secret-metrics-server-client-certs\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:35.950910 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.948961 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f229cb40-f8c1-4b59-8b3c-a281d01937bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:35.950910 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.949001 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-secret-metrics-server-tls\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:35.950910 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.949029 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-client-ca-bundle\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:35.950910 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:35.949059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f229cb40-f8c1-4b59-8b3c-a281d01937bc-audit-log\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.051072 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.050355 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f229cb40-f8c1-4b59-8b3c-a281d01937bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.051072 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.050405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-secret-metrics-server-tls\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.051072 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.050435 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-client-ca-bundle\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.051072 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.050462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f229cb40-f8c1-4b59-8b3c-a281d01937bc-audit-log\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.051072 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.050504 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f229cb40-f8c1-4b59-8b3c-a281d01937bc-metrics-server-audit-profiles\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.051072 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.050739 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrfb\" (UniqueName: \"kubernetes.io/projected/f229cb40-f8c1-4b59-8b3c-a281d01937bc-kube-api-access-fvrfb\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.051072 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.050792 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-secret-metrics-server-client-certs\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.051072 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.051012 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f229cb40-f8c1-4b59-8b3c-a281d01937bc-audit-log\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.052015 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.051988 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f229cb40-f8c1-4b59-8b3c-a281d01937bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.052133 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.052075 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f229cb40-f8c1-4b59-8b3c-a281d01937bc-metrics-server-audit-profiles\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.054282 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.054237 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-secret-metrics-server-tls\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.054541 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.054517 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-secret-metrics-server-client-certs\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.056737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.056713 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f229cb40-f8c1-4b59-8b3c-a281d01937bc-client-ca-bundle\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.059341 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.059318 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrfb\" (UniqueName: \"kubernetes.io/projected/f229cb40-f8c1-4b59-8b3c-a281d01937bc-kube-api-access-fvrfb\") pod \"metrics-server-6fcc555d94-8wl78\" (UID: \"f229cb40-f8c1-4b59-8b3c-a281d01937bc\") " pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.169397 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.169296 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:36.334091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.334054 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr"] Jul 13 23:40:36.338918 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.338886 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:36.341520 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.341232 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:36.342169 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.342142 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 13 23:40:36.342290 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.342207 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2xq6p\"" Jul 13 23:40:36.352304 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.352275 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr"] Jul 13 23:40:36.355446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.355422 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dd5b49cd-jtq6v"] Jul 13 23:40:36.383943 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.383896 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79d648b964-5rnf8"] Jul 13 23:40:36.387744 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.387133 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.397688 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.397662 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79d648b964-5rnf8"] Jul 13 23:40:36.419237 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.419169 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453213 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckcg9\" (UniqueName: \"kubernetes.io/projected/201f2783-b7ef-4b5f-80ba-e6bb274b08c8-kube-api-access-ckcg9\") pod \"monitoring-plugin-5f68df7f58-bskxr\" (UID: \"201f2783-b7ef-4b5f-80ba-e6bb274b08c8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-oauth-config\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453315 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-config\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453371 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-oauth-serving-cert\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453398 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-serving-cert\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453423 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/201f2783-b7ef-4b5f-80ba-e6bb274b08c8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bskxr\" (UID: \"201f2783-b7ef-4b5f-80ba-e6bb274b08c8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453453 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-trusted-ca-bundle\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t75mn\" (UniqueName: \"kubernetes.io/projected/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-kube-api-access-t75mn\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.453651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.453508 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-service-ca\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.555272 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555021 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-oauth-config\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.555272 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-config\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.555272 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-oauth-serving-cert\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.555272 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555166 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-serving-cert\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.555272 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555192 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/201f2783-b7ef-4b5f-80ba-e6bb274b08c8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bskxr\" (UID: \"201f2783-b7ef-4b5f-80ba-e6bb274b08c8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:36.555272 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555222 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-trusted-ca-bundle\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.555272 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555250 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t75mn\" (UniqueName: \"kubernetes.io/projected/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-kube-api-access-t75mn\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.555272 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555275 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-service-ca\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.555772 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.555333 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckcg9\" (UniqueName: \"kubernetes.io/projected/201f2783-b7ef-4b5f-80ba-e6bb274b08c8-kube-api-access-ckcg9\") pod \"monitoring-plugin-5f68df7f58-bskxr\" (UID: \"201f2783-b7ef-4b5f-80ba-e6bb274b08c8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:36.556505 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.556475 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-config\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.557534 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.556923 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-oauth-serving-cert\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.557534 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.557485 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-service-ca\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.557679 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.557659 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-trusted-ca-bundle\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.559126 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.559081 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-serving-cert\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.560504 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.560461 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/201f2783-b7ef-4b5f-80ba-e6bb274b08c8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bskxr\" (UID: \"201f2783-b7ef-4b5f-80ba-e6bb274b08c8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:36.560690 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.560671 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-oauth-config\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.569801 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.569756 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t75mn\" (UniqueName: \"kubernetes.io/projected/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-kube-api-access-t75mn\") pod \"console-79d648b964-5rnf8\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.570521 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.570473 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckcg9\" (UniqueName: \"kubernetes.io/projected/201f2783-b7ef-4b5f-80ba-e6bb274b08c8-kube-api-access-ckcg9\") pod \"monitoring-plugin-5f68df7f58-bskxr\" (UID: \"201f2783-b7ef-4b5f-80ba-e6bb274b08c8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:36.580677 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.580646 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:36.653281 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.653245 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:36.699793 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.699532 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:36.760117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.760028 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66bbd968f6-mlbz2"] Jul 13 23:40:36.763361 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.763337 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.767109 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.767078 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 13 23:40:36.767421 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.767392 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 13 23:40:36.768086 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.767945 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p5bll\"" Jul 13 23:40:36.768086 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.768046 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 13 23:40:36.768679 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.768468 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 13 23:40:36.768679 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.768490 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 13 23:40:36.781493 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.781468 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 13 23:40:36.798118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.798048 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66bbd968f6-mlbz2"] Jul 13 23:40:36.857559 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.857522 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-secret-telemeter-client\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.858050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.857570 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.858050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.857597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-metrics-client-ca\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.858050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.857659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-serving-certs-ca-bundle\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.858050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.857716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q95wx\" (UniqueName: \"kubernetes.io/projected/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-kube-api-access-q95wx\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.858050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.857755 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.858050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.857869 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-federate-client-tls\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.858050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.857915 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-telemeter-client-tls\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.958955 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.958918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-federate-client-tls\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.959242 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.958991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-telemeter-client-tls\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.959242 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.959104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-secret-telemeter-client\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.959242 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.959146 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.959242 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.959187 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-metrics-client-ca\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.959242 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.959233 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-serving-certs-ca-bundle\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.959576 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.959353 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q95wx\" (UniqueName: \"kubernetes.io/projected/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-kube-api-access-q95wx\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.959576 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.959455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.960223 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.960195 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-metrics-client-ca\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.960523 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.960498 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.961138 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.961096 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-serving-certs-ca-bundle\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.962463 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.962442 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-secret-telemeter-client\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.962733 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.962689 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-telemeter-client-tls\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.963281 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.963221 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-federate-client-tls\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.963281 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.963221 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:36.969310 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:36.969287 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q95wx\" (UniqueName: \"kubernetes.io/projected/daa5ce9f-cd11-414e-8ae5-d90cb0fe2022-kube-api-access-q95wx\") pod \"telemeter-client-66bbd968f6-mlbz2\" (UID: \"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022\") " pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:37.077571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:37.077536 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" Jul 13 23:40:37.312271 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:37.312222 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:37.359770 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:37.359641 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:37.697867 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:37.697756 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:40:37.742653 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:37.742618 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:38.002996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:38.002897 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:38.103436 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:38.103367 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:39.750021 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.749971 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fcc555d94-8wl78"] Jul 13 23:40:39.786316 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.786275 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr"] Jul 13 23:40:39.803779 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.803672 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79d648b964-5rnf8"] Jul 13 23:40:39.816204 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:39.815952 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201f2783_b7ef_4b5f_80ba_e6bb274b08c8.slice/crio-6cca31a0f49ca0cb22f15eed6e72cc0d852758c2ac0a308f96502dd01e6c21ab WatchSource:0}: Error finding container 6cca31a0f49ca0cb22f15eed6e72cc0d852758c2ac0a308f96502dd01e6c21ab: Status 404 returned error can't find the container with id 6cca31a0f49ca0cb22f15eed6e72cc0d852758c2ac0a308f96502dd01e6c21ab Jul 13 23:40:39.816590 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:39.816561 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fd45e7_664c_4e53_8ab7_df10ed6bf849.slice/crio-ac2a0f2dbc0870c0a0aa96c1ec2c17e5df08ad4f44c3fad301653d68947fe325 WatchSource:0}: Error finding container ac2a0f2dbc0870c0a0aa96c1ec2c17e5df08ad4f44c3fad301653d68947fe325: Status 404 returned error can't find the container with id ac2a0f2dbc0870c0a0aa96c1ec2c17e5df08ad4f44c3fad301653d68947fe325 Jul 13 23:40:39.887174 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.887142 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbbz9" event={"ID":"a062baa3-3416-400c-8bad-dd6c9379758e","Type":"ContainerStarted","Data":"65329b23b5e06bd4e8662900b099779e6aa1611f062c8ca9ad410b62cd80736b"} Jul 13 23:40:39.887295 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.887207 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbbz9" event={"ID":"a062baa3-3416-400c-8bad-dd6c9379758e","Type":"ContainerStarted","Data":"1fb35ed910605d69faaca60751e3ea81b6c6c92059877da5f7e7aa6f3679dbd4"} Jul 13 23:40:39.889806 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.889221 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" event={"ID":"f229cb40-f8c1-4b59-8b3c-a281d01937bc","Type":"ContainerStarted","Data":"40fcc8503a376ada84e6de6cb125055fc701ee440754d8f48245b135c5354aad"} Jul 13 23:40:39.894470 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.894427 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j5fqw" event={"ID":"0682b2bb-d5b8-462f-80cf-a45595cd7ed1","Type":"ContainerStarted","Data":"85470208a251e57fa088aef502fed216f7d132a83d5db74abe2bba385b3b0b09"} Jul 13 23:40:39.894622 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.894594 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:40:39.896491 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.896467 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vtl5" event={"ID":"6bcab85d-5d09-44f9-906a-f2a1a9455253","Type":"ContainerStarted","Data":"3aa001d19147bb92e74824c3a95be5579d2061a336dd213b753f3e0d858bb74d"} Jul 13 23:40:39.907916 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.904926 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mbbz9" podStartSLOduration=67.052813912 podStartE2EDuration="1m12.904908932s" totalImagesPullingTime="5.85209502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:39.904740559 +0000 UTC m=+72.872436411" watchObservedRunningTime="2026-07-13 23:40:39.904908932 +0000 UTC m=+72.872604786" Jul 13 23:40:39.909133 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.909078 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d648b964-5rnf8" event={"ID":"d2fd45e7-664c-4e53-8ab7-df10ed6bf849","Type":"ContainerStarted","Data":"ac2a0f2dbc0870c0a0aa96c1ec2c17e5df08ad4f44c3fad301653d68947fe325"} Jul 13 23:40:39.911864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.911838 2557 generic.go:356] "Generic (PLEG): container finished" podID="5add1f37-01b9-4d4c-afe0-960250fe22f4" containerID="0dd76281acd25ca7cd3a14bc96c1e768ad6bbbb6f431ce4c7a53b8507c25b023" exitCode=0 Jul 13 23:40:39.912057 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.911914 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5add1f37-01b9-4d4c-afe0-960250fe22f4","Type":"ContainerDied","Data":"0dd76281acd25ca7cd3a14bc96c1e768ad6bbbb6f431ce4c7a53b8507c25b023"} Jul 13 23:40:39.914628 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.914603 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" event={"ID":"8eb20c2c-19d0-4c94-b01e-102229118f2b","Type":"ContainerStarted","Data":"7aac2cc4a17b65bf01711552f1aa4a548ee8517579539181cb2cde9ff738f9f4"} Jul 13 23:40:39.914696 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.914662 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" event={"ID":"8eb20c2c-19d0-4c94-b01e-102229118f2b","Type":"ContainerStarted","Data":"871c0c4a18317435b0238a0ae63cc329f9120b44a1636f80007e6bf5e425efd7"} Jul 13 23:40:39.915865 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.915843 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" event={"ID":"201f2783-b7ef-4b5f-80ba-e6bb274b08c8","Type":"ContainerStarted","Data":"6cca31a0f49ca0cb22f15eed6e72cc0d852758c2ac0a308f96502dd01e6c21ab"} Jul 13 23:40:39.925423 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.925309 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5vtl5" podStartSLOduration=66.995437309 podStartE2EDuration="1m12.925290068s" totalImagesPullingTime="5.929852759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:39.923266721 +0000 UTC m=+72.890962571" watchObservedRunningTime="2026-07-13 23:40:39.925290068 +0000 UTC m=+72.892985916" Jul 13 23:40:39.937320 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.937270 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j5fqw" podStartSLOduration=67.069234064 podStartE2EDuration="1m12.937251382s" totalImagesPullingTime="5.868017318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:39.936605367 +0000 UTC m=+72.904301217" watchObservedRunningTime="2026-07-13 23:40:39.937251382 +0000 UTC m=+72.904947235" Jul 13 23:40:39.956573 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.956512 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79d648b964-5rnf8" podStartSLOduration=3.95649095 podStartE2EDuration="3.95649095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:39.954622608 +0000 UTC m=+72.922318457" watchObservedRunningTime="2026-07-13 23:40:39.95649095 +0000 UTC m=+72.924186801" Jul 13 23:40:39.999077 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:39.999043 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:40.017774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:40.017751 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66bbd968f6-mlbz2"] Jul 13 23:40:40.019691 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:40.019665 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa5ce9f_cd11_414e_8ae5_d90cb0fe2022.slice/crio-6a27df64d6e0a67f904ab47df4b923c179b1545d83a547f5d528d81772ae18ee WatchSource:0}: Error finding container 6a27df64d6e0a67f904ab47df4b923c179b1545d83a547f5d528d81772ae18ee: Status 404 returned error can't find the container with id 6a27df64d6e0a67f904ab47df4b923c179b1545d83a547f5d528d81772ae18ee Jul 13 23:40:40.115927 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:40.115883 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:40.922615 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:40.922573 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d648b964-5rnf8" event={"ID":"d2fd45e7-664c-4e53-8ab7-df10ed6bf849","Type":"ContainerStarted","Data":"f629c82c52ca1967d9863cbaf495d38876a2284027872e6c9cf5b3616b27a020"} Jul 13 23:40:40.924208 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:40.924142 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" event={"ID":"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022","Type":"ContainerStarted","Data":"6a27df64d6e0a67f904ab47df4b923c179b1545d83a547f5d528d81772ae18ee"} Jul 13 23:40:40.926952 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:40.926872 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" event={"ID":"8eb20c2c-19d0-4c94-b01e-102229118f2b","Type":"ContainerStarted","Data":"78f3dd232fc04b2174c86d7e2c1c0811f286e9b15bfdb43839a41d6a17abdf0d"} Jul 13 23:40:42.326024 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.325978 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:42.421889 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.421854 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:42.938392 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.938350 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" event={"ID":"8eb20c2c-19d0-4c94-b01e-102229118f2b","Type":"ContainerStarted","Data":"f0f237448c0028ccf136f223dd9985d18d32397232db923edd1254db9b6cc12f"} Jul 13 23:40:42.938565 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.938470 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" event={"ID":"8eb20c2c-19d0-4c94-b01e-102229118f2b","Type":"ContainerStarted","Data":"2d863f0996721d8880ab66fc16a7548ce017a454799d655ae5b9174216519720"} Jul 13 23:40:42.938565 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.938503 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" event={"ID":"8eb20c2c-19d0-4c94-b01e-102229118f2b","Type":"ContainerStarted","Data":"d6c90dd9a2fa52e59174be81d21701ba019ced08049111a6acce1775975be9d2"} Jul 13 23:40:42.938565 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.938560 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:42.939996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.939958 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" event={"ID":"201f2783-b7ef-4b5f-80ba-e6bb274b08c8","Type":"ContainerStarted","Data":"38abd7c417cadc3e2ed169ec898e9003abff1e53926b58c943922aaa91c6c3ef"} Jul 13 23:40:42.940106 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.940016 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:42.941682 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.941657 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" event={"ID":"f229cb40-f8c1-4b59-8b3c-a281d01937bc","Type":"ContainerStarted","Data":"bcafc159cf19415ca445a7fe05a1875bc89dd813342f3c6a3e3430c570ea3c82"} Jul 13 23:40:42.945332 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.945305 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5add1f37-01b9-4d4c-afe0-960250fe22f4","Type":"ContainerStarted","Data":"3074c7a9e2db8d61d9a085e7a527e9bf721faf8d178159eb71bd75b8a04d2821"} Jul 13 23:40:42.945446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.945417 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5add1f37-01b9-4d4c-afe0-960250fe22f4","Type":"ContainerStarted","Data":"318e9061eb068643d70aa477a5576878b7674419cb2b53a8374021174d022cb0"} Jul 13 23:40:42.945515 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.945450 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5add1f37-01b9-4d4c-afe0-960250fe22f4","Type":"ContainerStarted","Data":"c611bd3e5524bc3241db9f7c46ee3084f6a05544dcacc700e6c2a4a22c95d905"} Jul 13 23:40:42.945515 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.945491 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5add1f37-01b9-4d4c-afe0-960250fe22f4","Type":"ContainerStarted","Data":"274b8a5ae438a6cbd7b28593045ac14a89c960e54ecf171ea0d65ce14d43981e"} Jul 13 23:40:42.945604 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.945529 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5add1f37-01b9-4d4c-afe0-960250fe22f4","Type":"ContainerStarted","Data":"27e1070251414703e93f879feb5362bc1cd95b721ebf965ff7ce086b5bf16c1d"} Jul 13 23:40:42.945604 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.945568 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5add1f37-01b9-4d4c-afe0-960250fe22f4","Type":"ContainerStarted","Data":"18a070e6367ee866d0755f2915e1b7111bb669bf932f604602bca7732c095ee6"} Jul 13 23:40:42.946246 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.946226 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" Jul 13 23:40:42.947732 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.947710 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" event={"ID":"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022","Type":"ContainerStarted","Data":"51c38be4b33455b5faac59737254ce596d011a01e119f03f0a8b865f1a92369f"} Jul 13 23:40:42.947807 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.947758 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" event={"ID":"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022","Type":"ContainerStarted","Data":"d15e8f670f68a5514a6b90d0dd14be3e7d679bc36cdfb8b79cb61468b967e396"} Jul 13 23:40:42.947807 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.947788 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" event={"ID":"daa5ce9f-cd11-414e-8ae5-d90cb0fe2022","Type":"ContainerStarted","Data":"2770a4fabd408bef1a88322a436dddfd68ffe4cc9b02b8fab46e29d677747054"} Jul 13 23:40:42.964088 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.964041 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" podStartSLOduration=2.4541614640000002 podStartE2EDuration="8.96402814s" totalImagesPullingTime="6.509866676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:42.962759389 +0000 UTC m=+75.930455241" watchObservedRunningTime="2026-07-13 23:40:42.96402814 +0000 UTC m=+75.931723990" Jul 13 23:40:42.992221 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:42.992171 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.052569705 podStartE2EDuration="10.992153444s" totalImagesPullingTime="7.909987254s" totalInitContainerRuntime="29.596485ms" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:42.990587214 +0000 UTC m=+75.958283059" watchObservedRunningTime="2026-07-13 23:40:42.992153444 +0000 UTC m=+75.959849293" Jul 13 23:40:43.036003 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:43.035957 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" podStartSLOduration=5.7672384359999995 podStartE2EDuration="8.035940845s" totalImagesPullingTime="2.268702409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:43.034859698 +0000 UTC m=+76.002555549" watchObservedRunningTime="2026-07-13 23:40:43.035940845 +0000 UTC m=+76.003636695" Jul 13 23:40:43.036609 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:43.036576 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bskxr" podStartSLOduration=4.828808812 podStartE2EDuration="7.036568704s" totalImagesPullingTime="2.207759892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:43.012335266 +0000 UTC m=+75.980031115" watchObservedRunningTime="2026-07-13 23:40:43.036568704 +0000 UTC m=+76.004264574" Jul 13 23:40:43.058452 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:43.058405 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66bbd968f6-mlbz2" podStartSLOduration=4.558907738 podStartE2EDuration="7.058390657s" totalImagesPullingTime="2.499482919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:43.057060968 +0000 UTC m=+76.024756818" watchObservedRunningTime="2026-07-13 23:40:43.058390657 +0000 UTC m=+76.026086506" Jul 13 23:40:43.839053 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:43.839013 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79d648b964-5rnf8"] Jul 13 23:40:43.865514 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:43.865477 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b5bfdf4df-7csrp"] Jul 13 23:40:43.869019 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:43.869000 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:43.879573 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:43.879553 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5bfdf4df-7csrp"] Jul 13 23:40:44.032242 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.032195 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-oauth-config\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.032451 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.032417 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-serving-cert\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.032522 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.032462 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-trusted-ca-bundle\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.032593 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.032575 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-service-ca\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.032740 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.032713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-config\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.033235 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.033211 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6hvv\" (UniqueName: \"kubernetes.io/projected/fb78923b-cf9f-4a6e-b98c-a60051aee172-kube-api-access-c6hvv\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.033486 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.033461 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-oauth-serving-cert\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.134450 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.134351 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-oauth-config\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.134450 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.134405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-serving-cert\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.134450 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.134421 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-trusted-ca-bundle\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.134450 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.134448 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-service-ca\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.134754 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.134497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-config\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.134754 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.134549 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6hvv\" (UniqueName: \"kubernetes.io/projected/fb78923b-cf9f-4a6e-b98c-a60051aee172-kube-api-access-c6hvv\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.134754 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.134621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-oauth-serving-cert\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.135280 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.135254 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-service-ca\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.135380 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.135254 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-config\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.135475 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.135452 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-oauth-serving-cert\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.135576 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.135560 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-trusted-ca-bundle\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.137354 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.137300 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-oauth-config\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.137509 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.137487 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-serving-cert\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.142726 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.142702 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6hvv\" (UniqueName: \"kubernetes.io/projected/fb78923b-cf9f-4a6e-b98c-a60051aee172-kube-api-access-c6hvv\") pod \"console-7b5bfdf4df-7csrp\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.179868 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.179809 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:44.316206 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.316082 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5bfdf4df-7csrp"] Jul 13 23:40:44.318786 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:40:44.318761 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb78923b_cf9f_4a6e_b98c_a60051aee172.slice/crio-013baadc4c52f70957bf6509db3e408eb3b15f5b16ac3fdf5e1e48ee860a166a WatchSource:0}: Error finding container 013baadc4c52f70957bf6509db3e408eb3b15f5b16ac3fdf5e1e48ee860a166a: Status 404 returned error can't find the container with id 013baadc4c52f70957bf6509db3e408eb3b15f5b16ac3fdf5e1e48ee860a166a Jul 13 23:40:44.958706 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.958669 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5bfdf4df-7csrp" event={"ID":"fb78923b-cf9f-4a6e-b98c-a60051aee172","Type":"ContainerStarted","Data":"c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4"} Jul 13 23:40:44.959146 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.958722 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5bfdf4df-7csrp" event={"ID":"fb78923b-cf9f-4a6e-b98c-a60051aee172","Type":"ContainerStarted","Data":"013baadc4c52f70957bf6509db3e408eb3b15f5b16ac3fdf5e1e48ee860a166a"} Jul 13 23:40:44.977635 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:44.977578 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b5bfdf4df-7csrp" podStartSLOduration=1.977563635 podStartE2EDuration="1.977563635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:40:44.976280186 +0000 UTC m=+77.943976040" watchObservedRunningTime="2026-07-13 23:40:44.977563635 +0000 UTC m=+77.945259486" Jul 13 23:40:46.699675 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:46.699641 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:40:48.116208 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:48.116175 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:48.170540 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:48.170509 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:48.365659 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:48.365631 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:48.461869 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:48.461789 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:48.959087 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:48.959062 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-689769859f-v5spb" Jul 13 23:40:54.180754 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:54.180717 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:54.181198 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:54.180790 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:54.185842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:54.185807 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:55.004911 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:55.004884 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:40:55.049620 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:55.049586 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-546b4c79b-kgq2x"] Jul 13 23:40:55.148572 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:55.148541 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:55.250050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:55.250015 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:40:56.169638 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:56.169598 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:40:56.169813 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:40:56.169665 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:41:01.388554 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:01.388494 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66dd5b49cd-jtq6v" podUID="4692afef-ba11-4f2d-9420-1204df0d5c5c" containerName="console" containerID="cri-o://5f707138911dc85c85fc762d2677650c384d6d6e1a7ea07963f38aed15ec2e6d" gracePeriod=15 Jul 13 23:41:02.031638 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.031610 2557 generic.go:356] "Generic (PLEG): container finished" podID="4692afef-ba11-4f2d-9420-1204df0d5c5c" containerID="5f707138911dc85c85fc762d2677650c384d6d6e1a7ea07963f38aed15ec2e6d" exitCode=0 Jul 13 23:41:02.031720 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.031684 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dd5b49cd-jtq6v" event={"ID":"4692afef-ba11-4f2d-9420-1204df0d5c5c","Type":"ContainerDied","Data":"5f707138911dc85c85fc762d2677650c384d6d6e1a7ea07963f38aed15ec2e6d"} Jul 13 23:41:02.197987 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.197962 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:41:02.307127 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307061 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-config\") pod \"4692afef-ba11-4f2d-9420-1204df0d5c5c\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " Jul 13 23:41:02.307127 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307093 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-serving-cert\") pod \"4692afef-ba11-4f2d-9420-1204df0d5c5c\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " Jul 13 23:41:02.307127 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307116 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-oauth-config\") pod \"4692afef-ba11-4f2d-9420-1204df0d5c5c\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " Jul 13 23:41:02.307370 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307137 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-oauth-serving-cert\") pod \"4692afef-ba11-4f2d-9420-1204df0d5c5c\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " Jul 13 23:41:02.307370 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307247 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-trusted-ca-bundle\") pod \"4692afef-ba11-4f2d-9420-1204df0d5c5c\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " Jul 13 23:41:02.307479 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307379 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-service-ca\") pod \"4692afef-ba11-4f2d-9420-1204df0d5c5c\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " Jul 13 23:41:02.307479 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307409 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2vhm\" (UniqueName: \"kubernetes.io/projected/4692afef-ba11-4f2d-9420-1204df0d5c5c-kube-api-access-k2vhm\") pod \"4692afef-ba11-4f2d-9420-1204df0d5c5c\" (UID: \"4692afef-ba11-4f2d-9420-1204df0d5c5c\") " Jul 13 23:41:02.307479 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307418 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-config" (OuterVolumeSpecName: "console-config") pod "4692afef-ba11-4f2d-9420-1204df0d5c5c" (UID: "4692afef-ba11-4f2d-9420-1204df0d5c5c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:02.307678 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307647 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4692afef-ba11-4f2d-9420-1204df0d5c5c" (UID: "4692afef-ba11-4f2d-9420-1204df0d5c5c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:02.307729 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307666 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-service-ca" (OuterVolumeSpecName: "service-ca") pod "4692afef-ba11-4f2d-9420-1204df0d5c5c" (UID: "4692afef-ba11-4f2d-9420-1204df0d5c5c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:02.307729 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307702 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:02.307805 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.307758 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4692afef-ba11-4f2d-9420-1204df0d5c5c" (UID: "4692afef-ba11-4f2d-9420-1204df0d5c5c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:02.309596 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.309573 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4692afef-ba11-4f2d-9420-1204df0d5c5c-kube-api-access-k2vhm" (OuterVolumeSpecName: "kube-api-access-k2vhm") pod "4692afef-ba11-4f2d-9420-1204df0d5c5c" (UID: "4692afef-ba11-4f2d-9420-1204df0d5c5c"). InnerVolumeSpecName "kube-api-access-k2vhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:41:02.309596 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.309580 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4692afef-ba11-4f2d-9420-1204df0d5c5c" (UID: "4692afef-ba11-4f2d-9420-1204df0d5c5c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:41:02.309755 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.309666 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4692afef-ba11-4f2d-9420-1204df0d5c5c" (UID: "4692afef-ba11-4f2d-9420-1204df0d5c5c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:41:02.408263 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.408231 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-oauth-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:02.408263 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.408256 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-oauth-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:02.408263 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.408266 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-trusted-ca-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:02.408660 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.408278 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4692afef-ba11-4f2d-9420-1204df0d5c5c-service-ca\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:02.408660 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.408286 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2vhm\" (UniqueName: \"kubernetes.io/projected/4692afef-ba11-4f2d-9420-1204df0d5c5c-kube-api-access-k2vhm\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:02.408660 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:02.408296 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4692afef-ba11-4f2d-9420-1204df0d5c5c-console-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:03.037325 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:03.037288 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dd5b49cd-jtq6v" event={"ID":"4692afef-ba11-4f2d-9420-1204df0d5c5c","Type":"ContainerDied","Data":"d3f07e00fce234b1755546cc10f51335c567a7d7e329c409aaa1f381144440a5"} Jul 13 23:41:03.037325 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:03.037318 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dd5b49cd-jtq6v" Jul 13 23:41:03.037527 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:03.037349 2557 scope.go:117] "RemoveContainer" containerID="5f707138911dc85c85fc762d2677650c384d6d6e1a7ea07963f38aed15ec2e6d" Jul 13 23:41:03.059357 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:03.059334 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dd5b49cd-jtq6v"] Jul 13 23:41:03.063628 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:03.063604 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66dd5b49cd-jtq6v"] Jul 13 23:41:03.358413 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:03.358378 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:03.426249 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:03.426212 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:03.514782 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:03.514749 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4692afef-ba11-4f2d-9420-1204df0d5c5c" path="/var/lib/kubelet/pods/4692afef-ba11-4f2d-9420-1204df0d5c5c/volumes" Jul 13 23:41:04.072931 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:04.072905 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lrxjb_474181f5-67e9-4645-aa60-cfef7b205721/serve-healthcheck-canary/0.log" Jul 13 23:41:08.860444 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:08.860383 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79d648b964-5rnf8" podUID="d2fd45e7-664c-4e53-8ab7-df10ed6bf849" containerName="console" containerID="cri-o://f629c82c52ca1967d9863cbaf495d38876a2284027872e6c9cf5b3616b27a020" gracePeriod=15 Jul 13 23:41:09.067758 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.067731 2557 generic.go:356] "Generic (PLEG): container finished" podID="d2fd45e7-664c-4e53-8ab7-df10ed6bf849" containerID="f629c82c52ca1967d9863cbaf495d38876a2284027872e6c9cf5b3616b27a020" exitCode=0 Jul 13 23:41:09.067910 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.067794 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d648b964-5rnf8" event={"ID":"d2fd45e7-664c-4e53-8ab7-df10ed6bf849","Type":"ContainerDied","Data":"f629c82c52ca1967d9863cbaf495d38876a2284027872e6c9cf5b3616b27a020"} Jul 13 23:41:09.147342 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.147283 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:41:09.265968 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.265942 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-oauth-serving-cert\") pod \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " Jul 13 23:41:09.266117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.265978 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-oauth-config\") pod \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " Jul 13 23:41:09.266117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266000 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t75mn\" (UniqueName: \"kubernetes.io/projected/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-kube-api-access-t75mn\") pod \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " Jul 13 23:41:09.266117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266027 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-trusted-ca-bundle\") pod \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " Jul 13 23:41:09.266117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266057 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-serving-cert\") pod \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " Jul 13 23:41:09.266117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266078 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-service-ca\") pod \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " Jul 13 23:41:09.266117 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266100 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-config\") pod \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\" (UID: \"d2fd45e7-664c-4e53-8ab7-df10ed6bf849\") " Jul 13 23:41:09.266655 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266622 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2fd45e7-664c-4e53-8ab7-df10ed6bf849" (UID: "d2fd45e7-664c-4e53-8ab7-df10ed6bf849"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:09.266747 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266633 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-config" (OuterVolumeSpecName: "console-config") pod "d2fd45e7-664c-4e53-8ab7-df10ed6bf849" (UID: "d2fd45e7-664c-4e53-8ab7-df10ed6bf849"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:09.266747 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266630 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d2fd45e7-664c-4e53-8ab7-df10ed6bf849" (UID: "d2fd45e7-664c-4e53-8ab7-df10ed6bf849"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:09.266747 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.266665 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2fd45e7-664c-4e53-8ab7-df10ed6bf849" (UID: "d2fd45e7-664c-4e53-8ab7-df10ed6bf849"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:09.268342 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.268317 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2fd45e7-664c-4e53-8ab7-df10ed6bf849" (UID: "d2fd45e7-664c-4e53-8ab7-df10ed6bf849"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:41:09.268512 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.268493 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2fd45e7-664c-4e53-8ab7-df10ed6bf849" (UID: "d2fd45e7-664c-4e53-8ab7-df10ed6bf849"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:41:09.268571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.268532 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-kube-api-access-t75mn" (OuterVolumeSpecName: "kube-api-access-t75mn") pod "d2fd45e7-664c-4e53-8ab7-df10ed6bf849" (UID: "d2fd45e7-664c-4e53-8ab7-df10ed6bf849"). InnerVolumeSpecName "kube-api-access-t75mn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:41:09.367173 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.367148 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t75mn\" (UniqueName: \"kubernetes.io/projected/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-kube-api-access-t75mn\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:09.367173 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.367169 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-trusted-ca-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:09.367288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.367179 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:09.367288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.367189 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-service-ca\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:09.367288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.367197 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:09.367288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.367205 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-oauth-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:09.367288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:09.367213 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2fd45e7-664c-4e53-8ab7-df10ed6bf849-console-oauth-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:10.075217 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.075174 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d648b964-5rnf8" event={"ID":"d2fd45e7-664c-4e53-8ab7-df10ed6bf849","Type":"ContainerDied","Data":"ac2a0f2dbc0870c0a0aa96c1ec2c17e5df08ad4f44c3fad301653d68947fe325"} Jul 13 23:41:10.075650 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.075293 2557 scope.go:117] "RemoveContainer" containerID="f629c82c52ca1967d9863cbaf495d38876a2284027872e6c9cf5b3616b27a020" Jul 13 23:41:10.075724 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.075702 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d648b964-5rnf8" Jul 13 23:41:10.091838 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.091803 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79d648b964-5rnf8"] Jul 13 23:41:10.095111 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.095091 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79d648b964-5rnf8"] Jul 13 23:41:10.554254 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.554151 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:10.653132 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.653090 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:10.706528 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.706497 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:10.929583 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:10.929551 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j5fqw" Jul 13 23:41:11.514953 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:11.514919 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2fd45e7-664c-4e53-8ab7-df10ed6bf849" path="/var/lib/kubelet/pods/d2fd45e7-664c-4e53-8ab7-df10ed6bf849/volumes" Jul 13 23:41:11.684455 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:11.684428 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:11.730373 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:11.730344 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:16.175263 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:16.175234 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:41:16.179668 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:16.179639 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fcc555d94-8wl78" Jul 13 23:41:20.069805 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.069764 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-546b4c79b-kgq2x" podUID="f307bfa2-311b-41f7-8154-a148b0819adc" containerName="console" containerID="cri-o://732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358" gracePeriod=15 Jul 13 23:41:20.310372 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.310349 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:41:20.469088 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.468999 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-serving-cert\") pod \"f307bfa2-311b-41f7-8154-a148b0819adc\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " Jul 13 23:41:20.469088 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.469040 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lfg6\" (UniqueName: \"kubernetes.io/projected/f307bfa2-311b-41f7-8154-a148b0819adc-kube-api-access-8lfg6\") pod \"f307bfa2-311b-41f7-8154-a148b0819adc\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " Jul 13 23:41:20.469088 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.469061 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-oauth-serving-cert\") pod \"f307bfa2-311b-41f7-8154-a148b0819adc\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " Jul 13 23:41:20.469369 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.469193 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-console-config\") pod \"f307bfa2-311b-41f7-8154-a148b0819adc\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " Jul 13 23:41:20.469369 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.469266 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-service-ca\") pod \"f307bfa2-311b-41f7-8154-a148b0819adc\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " Jul 13 23:41:20.469369 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.469299 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-oauth-config\") pod \"f307bfa2-311b-41f7-8154-a148b0819adc\" (UID: \"f307bfa2-311b-41f7-8154-a148b0819adc\") " Jul 13 23:41:20.469559 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.469462 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f307bfa2-311b-41f7-8154-a148b0819adc" (UID: "f307bfa2-311b-41f7-8154-a148b0819adc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:20.469626 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.469589 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-console-config" (OuterVolumeSpecName: "console-config") pod "f307bfa2-311b-41f7-8154-a148b0819adc" (UID: "f307bfa2-311b-41f7-8154-a148b0819adc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:20.469626 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.469611 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-service-ca" (OuterVolumeSpecName: "service-ca") pod "f307bfa2-311b-41f7-8154-a148b0819adc" (UID: "f307bfa2-311b-41f7-8154-a148b0819adc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:41:20.471234 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.471202 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f307bfa2-311b-41f7-8154-a148b0819adc" (UID: "f307bfa2-311b-41f7-8154-a148b0819adc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:41:20.471352 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.471290 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f307bfa2-311b-41f7-8154-a148b0819adc" (UID: "f307bfa2-311b-41f7-8154-a148b0819adc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:41:20.471352 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.471294 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f307bfa2-311b-41f7-8154-a148b0819adc-kube-api-access-8lfg6" (OuterVolumeSpecName: "kube-api-access-8lfg6") pod "f307bfa2-311b-41f7-8154-a148b0819adc" (UID: "f307bfa2-311b-41f7-8154-a148b0819adc"). InnerVolumeSpecName "kube-api-access-8lfg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:41:20.570486 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.570458 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-service-ca\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:20.570486 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.570483 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-oauth-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:20.570486 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.570493 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f307bfa2-311b-41f7-8154-a148b0819adc-console-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:20.570681 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.570503 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lfg6\" (UniqueName: \"kubernetes.io/projected/f307bfa2-311b-41f7-8154-a148b0819adc-kube-api-access-8lfg6\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:20.570681 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.570513 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-oauth-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:20.570681 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:20.570542 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f307bfa2-311b-41f7-8154-a148b0819adc-console-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:41:21.130830 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.130782 2557 generic.go:356] "Generic (PLEG): container finished" podID="f307bfa2-311b-41f7-8154-a148b0819adc" containerID="732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358" exitCode=0 Jul 13 23:41:21.131238 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.130844 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-546b4c79b-kgq2x" Jul 13 23:41:21.131238 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.130867 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-546b4c79b-kgq2x" event={"ID":"f307bfa2-311b-41f7-8154-a148b0819adc","Type":"ContainerDied","Data":"732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358"} Jul 13 23:41:21.131238 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.130918 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-546b4c79b-kgq2x" event={"ID":"f307bfa2-311b-41f7-8154-a148b0819adc","Type":"ContainerDied","Data":"c0fc8c54a24851c10510e561b69ad4cc67af3151b9e7ceec82f5a4d2ee567c41"} Jul 13 23:41:21.131238 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.130939 2557 scope.go:117] "RemoveContainer" containerID="732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358" Jul 13 23:41:21.139678 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.139661 2557 scope.go:117] "RemoveContainer" containerID="732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358" Jul 13 23:41:21.139941 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:41:21.139920 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358\": container with ID starting with 732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358 not found: ID does not exist" containerID="732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358" Jul 13 23:41:21.140002 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.139960 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358"} err="failed to get container status \"732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358\": rpc error: code = NotFound desc = could not find container \"732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358\": container with ID starting with 732c82e63290192485722e720abdd05407e68afccb1f412f98bf5f99e5cd7358 not found: ID does not exist" Jul 13 23:41:21.151380 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.151359 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-546b4c79b-kgq2x"] Jul 13 23:41:21.155338 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.155318 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-546b4c79b-kgq2x"] Jul 13 23:41:21.515668 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:21.515590 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f307bfa2-311b-41f7-8154-a148b0819adc" path="/var/lib/kubelet/pods/f307bfa2-311b-41f7-8154-a148b0819adc/volumes" Jul 13 23:41:47.626202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:47.626166 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:47.679064 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:47.679036 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:49.210190 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:49.210151 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:50.483335 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483305 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c967584b-d2k7g"] Jul 13 23:41:50.483714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483626 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2fd45e7-664c-4e53-8ab7-df10ed6bf849" containerName="console" Jul 13 23:41:50.483714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483638 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2fd45e7-664c-4e53-8ab7-df10ed6bf849" containerName="console" Jul 13 23:41:50.483714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483651 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4692afef-ba11-4f2d-9420-1204df0d5c5c" containerName="console" Jul 13 23:41:50.483714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483655 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4692afef-ba11-4f2d-9420-1204df0d5c5c" containerName="console" Jul 13 23:41:50.483714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483672 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f307bfa2-311b-41f7-8154-a148b0819adc" containerName="console" Jul 13 23:41:50.483714 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483678 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f307bfa2-311b-41f7-8154-a148b0819adc" containerName="console" Jul 13 23:41:50.483924 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483729 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2fd45e7-664c-4e53-8ab7-df10ed6bf849" containerName="console" Jul 13 23:41:50.483924 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483739 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f307bfa2-311b-41f7-8154-a148b0819adc" containerName="console" Jul 13 23:41:50.483924 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.483745 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4692afef-ba11-4f2d-9420-1204df0d5c5c" containerName="console" Jul 13 23:41:50.485752 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.485733 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.498198 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.498176 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c967584b-d2k7g"] Jul 13 23:41:50.537236 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.537211 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:50.589972 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.589940 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:50.615959 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.615936 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-oauth-config\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.616029 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.615970 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-console-config\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.616029 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.615994 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7qns\" (UniqueName: \"kubernetes.io/projected/c217697a-cc34-479f-936f-e667969db53c-kube-api-access-r7qns\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.616101 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.616055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-service-ca\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.616133 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.616121 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-trusted-ca-bundle\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.616165 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.616152 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-oauth-serving-cert\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.616196 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.616181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-serving-cert\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.682448 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.682416 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:50.717199 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.717175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-console-config\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.717343 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.717208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7qns\" (UniqueName: \"kubernetes.io/projected/c217697a-cc34-479f-936f-e667969db53c-kube-api-access-r7qns\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.717343 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.717228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-service-ca\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.717343 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.717275 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-trusted-ca-bundle\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.717343 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.717304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-oauth-serving-cert\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.717343 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.717336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-serving-cert\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.717583 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.717369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-oauth-config\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.718060 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.718033 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-console-config\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.718194 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.718182 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-service-ca\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.718267 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.718215 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-oauth-serving-cert\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.718505 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.718478 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-trusted-ca-bundle\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.719807 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.719787 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-serving-cert\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.719908 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.719863 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-oauth-config\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.724315 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.724292 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7qns\" (UniqueName: \"kubernetes.io/projected/c217697a-cc34-479f-936f-e667969db53c-kube-api-access-r7qns\") pod \"console-68c967584b-d2k7g\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.734740 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.734682 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:50.794704 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.794664 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:41:50.927165 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:50.927130 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c967584b-d2k7g"] Jul 13 23:41:50.930700 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:41:50.930668 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc217697a_cc34_479f_936f_e667969db53c.slice/crio-16ec22a3e22da75cb33a70c9498ede9827b3fcbcce5543f368b595fd2091e4fa WatchSource:0}: Error finding container 16ec22a3e22da75cb33a70c9498ede9827b3fcbcce5543f368b595fd2091e4fa: Status 404 returned error can't find the container with id 16ec22a3e22da75cb33a70c9498ede9827b3fcbcce5543f368b595fd2091e4fa Jul 13 23:41:51.251557 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:51.251519 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c967584b-d2k7g" event={"ID":"c217697a-cc34-479f-936f-e667969db53c","Type":"ContainerStarted","Data":"efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f"} Jul 13 23:41:51.251747 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:51.251575 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c967584b-d2k7g" event={"ID":"c217697a-cc34-479f-936f-e667969db53c","Type":"ContainerStarted","Data":"16ec22a3e22da75cb33a70c9498ede9827b3fcbcce5543f368b595fd2091e4fa"} Jul 13 23:41:51.269609 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:51.269556 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c967584b-d2k7g" podStartSLOduration=1.26953968 podStartE2EDuration="1.26953968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:41:51.267622212 +0000 UTC m=+144.235318063" watchObservedRunningTime="2026-07-13 23:41:51.26953968 +0000 UTC m=+144.237235530" Jul 13 23:41:51.278048 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:51.278019 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:51.328771 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:51.328745 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:59.522683 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:59.522654 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:41:59.580610 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:41:59.580573 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:00.795373 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:00.795341 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:42:00.795739 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:00.795435 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:42:00.800144 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:00.800121 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:42:01.296956 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:01.296927 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:42:01.334674 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:01.334638 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5bfdf4df-7csrp"] Jul 13 23:42:01.478020 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:01.477984 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:01.580752 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:01.580719 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:01.680642 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:01.680611 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:03.369133 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:03.369104 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:03.467631 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:03.467597 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:03.514709 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:03.514674 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:26.359910 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.359805 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b5bfdf4df-7csrp" podUID="fb78923b-cf9f-4a6e-b98c-a60051aee172" containerName="console" containerID="cri-o://c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4" gracePeriod=15 Jul 13 23:42:26.586533 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.586511 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:42:26.624598 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.624533 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-service-ca\") pod \"fb78923b-cf9f-4a6e-b98c-a60051aee172\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " Jul 13 23:42:26.624598 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.624567 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-serving-cert\") pod \"fb78923b-cf9f-4a6e-b98c-a60051aee172\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " Jul 13 23:42:26.624598 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.624589 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-oauth-config\") pod \"fb78923b-cf9f-4a6e-b98c-a60051aee172\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " Jul 13 23:42:26.624834 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.624709 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6hvv\" (UniqueName: \"kubernetes.io/projected/fb78923b-cf9f-4a6e-b98c-a60051aee172-kube-api-access-c6hvv\") pod \"fb78923b-cf9f-4a6e-b98c-a60051aee172\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " Jul 13 23:42:26.624834 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.624787 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-trusted-ca-bundle\") pod \"fb78923b-cf9f-4a6e-b98c-a60051aee172\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " Jul 13 23:42:26.624941 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.624866 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-config\") pod \"fb78923b-cf9f-4a6e-b98c-a60051aee172\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " Jul 13 23:42:26.624941 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.624885 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-service-ca" (OuterVolumeSpecName: "service-ca") pod "fb78923b-cf9f-4a6e-b98c-a60051aee172" (UID: "fb78923b-cf9f-4a6e-b98c-a60051aee172"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:42:26.625055 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.624957 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-oauth-serving-cert\") pod \"fb78923b-cf9f-4a6e-b98c-a60051aee172\" (UID: \"fb78923b-cf9f-4a6e-b98c-a60051aee172\") " Jul 13 23:42:26.625218 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.625202 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-service-ca\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:42:26.625285 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.625219 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fb78923b-cf9f-4a6e-b98c-a60051aee172" (UID: "fb78923b-cf9f-4a6e-b98c-a60051aee172"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:42:26.625392 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.625364 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-config" (OuterVolumeSpecName: "console-config") pod "fb78923b-cf9f-4a6e-b98c-a60051aee172" (UID: "fb78923b-cf9f-4a6e-b98c-a60051aee172"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:42:26.625454 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.625408 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fb78923b-cf9f-4a6e-b98c-a60051aee172" (UID: "fb78923b-cf9f-4a6e-b98c-a60051aee172"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:42:26.626800 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.626773 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb78923b-cf9f-4a6e-b98c-a60051aee172-kube-api-access-c6hvv" (OuterVolumeSpecName: "kube-api-access-c6hvv") pod "fb78923b-cf9f-4a6e-b98c-a60051aee172" (UID: "fb78923b-cf9f-4a6e-b98c-a60051aee172"). InnerVolumeSpecName "kube-api-access-c6hvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:42:26.626800 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.626786 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fb78923b-cf9f-4a6e-b98c-a60051aee172" (UID: "fb78923b-cf9f-4a6e-b98c-a60051aee172"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:42:26.626951 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.626923 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fb78923b-cf9f-4a6e-b98c-a60051aee172" (UID: "fb78923b-cf9f-4a6e-b98c-a60051aee172"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:42:26.725614 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.725583 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:42:26.725614 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.725607 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-oauth-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:42:26.725614 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.725617 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6hvv\" (UniqueName: \"kubernetes.io/projected/fb78923b-cf9f-4a6e-b98c-a60051aee172-kube-api-access-c6hvv\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:42:26.725863 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.725626 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-trusted-ca-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:42:26.725863 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.725636 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-console-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:42:26.725863 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:26.725644 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb78923b-cf9f-4a6e-b98c-a60051aee172-oauth-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:42:27.396525 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.396488 2557 generic.go:356] "Generic (PLEG): container finished" podID="fb78923b-cf9f-4a6e-b98c-a60051aee172" containerID="c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4" exitCode=0 Jul 13 23:42:27.396996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.396550 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5bfdf4df-7csrp" Jul 13 23:42:27.396996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.396568 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5bfdf4df-7csrp" event={"ID":"fb78923b-cf9f-4a6e-b98c-a60051aee172","Type":"ContainerDied","Data":"c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4"} Jul 13 23:42:27.396996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.396661 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5bfdf4df-7csrp" event={"ID":"fb78923b-cf9f-4a6e-b98c-a60051aee172","Type":"ContainerDied","Data":"013baadc4c52f70957bf6509db3e408eb3b15f5b16ac3fdf5e1e48ee860a166a"} Jul 13 23:42:27.396996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.396690 2557 scope.go:117] "RemoveContainer" containerID="c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4" Jul 13 23:42:27.404605 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.404592 2557 scope.go:117] "RemoveContainer" containerID="c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4" Jul 13 23:42:27.404864 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:42:27.404847 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4\": container with ID starting with c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4 not found: ID does not exist" containerID="c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4" Jul 13 23:42:27.404934 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.404869 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4"} err="failed to get container status \"c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4\": rpc error: code = NotFound desc = could not find container \"c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4\": container with ID starting with c9ad542d59fa4146db3fdfe84fc47c59e98da16e1bea11a949c399231f7dfcb4 not found: ID does not exist" Jul 13 23:42:27.416112 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.416091 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5bfdf4df-7csrp"] Jul 13 23:42:27.418017 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.417996 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b5bfdf4df-7csrp"] Jul 13 23:42:27.514524 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:27.514492 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb78923b-cf9f-4a6e-b98c-a60051aee172" path="/var/lib/kubelet/pods/fb78923b-cf9f-4a6e-b98c-a60051aee172/volumes" Jul 13 23:42:34.186495 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:34.186460 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:34.293281 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:34.293250 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:45.805750 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:45.805697 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:45.902191 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:45.902149 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:42:46.414438 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.414401 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2"] Jul 13 23:42:46.414767 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.414754 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb78923b-cf9f-4a6e-b98c-a60051aee172" containerName="console" Jul 13 23:42:46.414808 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.414769 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb78923b-cf9f-4a6e-b98c-a60051aee172" containerName="console" Jul 13 23:42:46.414862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.414849 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb78923b-cf9f-4a6e-b98c-a60051aee172" containerName="console" Jul 13 23:42:46.417876 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.417857 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.420704 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.420685 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 23:42:46.421700 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.421685 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hzgp5\"" Jul 13 23:42:46.421792 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.421697 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 23:42:46.425421 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.425399 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2"] Jul 13 23:42:46.475622 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.475592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hnc5\" (UniqueName: \"kubernetes.io/projected/1b6201ff-aa91-4c00-9e10-5163be9de5ab-kube-api-access-8hnc5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.475781 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.475629 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.475781 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.475650 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.576277 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.576239 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hnc5\" (UniqueName: \"kubernetes.io/projected/1b6201ff-aa91-4c00-9e10-5163be9de5ab-kube-api-access-8hnc5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.576424 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.576283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.576424 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.576311 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.576726 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.576701 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.576760 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.576708 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.584241 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.584203 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hnc5\" (UniqueName: \"kubernetes.io/projected/1b6201ff-aa91-4c00-9e10-5163be9de5ab-kube-api-access-8hnc5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.727240 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.727152 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:42:46.850141 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:46.850114 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2"] Jul 13 23:42:46.852595 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:42:46.852571 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6201ff_aa91_4c00_9e10_5163be9de5ab.slice/crio-7aa2921a41245ca07a946edb43c8567770fad394004eecfb0fa44e27607a26c8 WatchSource:0}: Error finding container 7aa2921a41245ca07a946edb43c8567770fad394004eecfb0fa44e27607a26c8: Status 404 returned error can't find the container with id 7aa2921a41245ca07a946edb43c8567770fad394004eecfb0fa44e27607a26c8 Jul 13 23:42:47.473412 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:47.473379 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" event={"ID":"1b6201ff-aa91-4c00-9e10-5163be9de5ab","Type":"ContainerStarted","Data":"7aa2921a41245ca07a946edb43c8567770fad394004eecfb0fa44e27607a26c8"} Jul 13 23:42:54.504290 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:54.504256 2557 generic.go:356] "Generic (PLEG): container finished" podID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerID="1efacb6e46d37ab99922af45c25be7dd274d4eb4dabc2db098910d991268c0e4" exitCode=0 Jul 13 23:42:54.504652 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:54.504319 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" event={"ID":"1b6201ff-aa91-4c00-9e10-5163be9de5ab","Type":"ContainerDied","Data":"1efacb6e46d37ab99922af45c25be7dd274d4eb4dabc2db098910d991268c0e4"} Jul 13 23:42:56.514060 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:56.513980 2557 generic.go:356] "Generic (PLEG): container finished" podID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerID="5bce6e392003a9e71297152208570dfb7f432ed91da1b2da37db7ca83c8860ff" exitCode=0 Jul 13 23:42:56.514060 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:42:56.514025 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" event={"ID":"1b6201ff-aa91-4c00-9e10-5163be9de5ab","Type":"ContainerDied","Data":"5bce6e392003a9e71297152208570dfb7f432ed91da1b2da37db7ca83c8860ff"} Jul 13 23:43:05.553807 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:05.553769 2557 generic.go:356] "Generic (PLEG): container finished" podID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerID="34a961a9a6c570748b811491f3e53b1ecb66f2790da9c141ec8a6af181a829aa" exitCode=0 Jul 13 23:43:05.554215 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:05.553853 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" event={"ID":"1b6201ff-aa91-4c00-9e10-5163be9de5ab","Type":"ContainerDied","Data":"34a961a9a6c570748b811491f3e53b1ecb66f2790da9c141ec8a6af181a829aa"} Jul 13 23:43:06.684673 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.684651 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:43:06.761529 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.761502 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-bundle\") pod \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " Jul 13 23:43:06.761683 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.761547 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-util\") pod \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " Jul 13 23:43:06.761683 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.761597 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hnc5\" (UniqueName: \"kubernetes.io/projected/1b6201ff-aa91-4c00-9e10-5163be9de5ab-kube-api-access-8hnc5\") pod \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\" (UID: \"1b6201ff-aa91-4c00-9e10-5163be9de5ab\") " Jul 13 23:43:06.762349 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.762324 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-bundle" (OuterVolumeSpecName: "bundle") pod "1b6201ff-aa91-4c00-9e10-5163be9de5ab" (UID: "1b6201ff-aa91-4c00-9e10-5163be9de5ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:43:06.763748 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.763722 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b6201ff-aa91-4c00-9e10-5163be9de5ab-kube-api-access-8hnc5" (OuterVolumeSpecName: "kube-api-access-8hnc5") pod "1b6201ff-aa91-4c00-9e10-5163be9de5ab" (UID: "1b6201ff-aa91-4c00-9e10-5163be9de5ab"). InnerVolumeSpecName "kube-api-access-8hnc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:43:06.766025 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.766005 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-util" (OuterVolumeSpecName: "util") pod "1b6201ff-aa91-4c00-9e10-5163be9de5ab" (UID: "1b6201ff-aa91-4c00-9e10-5163be9de5ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:43:06.862538 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.862509 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hnc5\" (UniqueName: \"kubernetes.io/projected/1b6201ff-aa91-4c00-9e10-5163be9de5ab-kube-api-access-8hnc5\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:06.862538 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.862536 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:06.862709 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:06.862547 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b6201ff-aa91-4c00-9e10-5163be9de5ab-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:07.564333 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:07.564305 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" Jul 13 23:43:07.564333 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:07.564325 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vh7n2" event={"ID":"1b6201ff-aa91-4c00-9e10-5163be9de5ab","Type":"ContainerDied","Data":"7aa2921a41245ca07a946edb43c8567770fad394004eecfb0fa44e27607a26c8"} Jul 13 23:43:07.564499 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:07.564368 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7aa2921a41245ca07a946edb43c8567770fad394004eecfb0fa44e27607a26c8" Jul 13 23:43:09.629838 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:09.629796 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:12.434436 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:12.434404 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:13.272493 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:13.272456 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:14.402470 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.402434 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf"] Jul 13 23:43:14.402842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.402734 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerName="pull" Jul 13 23:43:14.402842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.402745 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerName="pull" Jul 13 23:43:14.402842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.402758 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerName="extract" Jul 13 23:43:14.402842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.402763 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerName="extract" Jul 13 23:43:14.402842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.402783 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerName="util" Jul 13 23:43:14.402842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.402788 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerName="util" Jul 13 23:43:14.403035 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.402863 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6201ff-aa91-4c00-9e10-5163be9de5ab" containerName="extract" Jul 13 23:43:14.406435 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.406417 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" Jul 13 23:43:14.409223 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.409196 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 23:43:14.409331 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.409196 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 23:43:14.409331 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.409239 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-f59vs\"" Jul 13 23:43:14.419271 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.419248 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf"] Jul 13 23:43:14.534027 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.533991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d23fd95-6e54-47b1-bb39-578b1314a255-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l62bf\" (UID: \"6d23fd95-6e54-47b1-bb39-578b1314a255\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" Jul 13 23:43:14.534191 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.534055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkp2j\" (UniqueName: \"kubernetes.io/projected/6d23fd95-6e54-47b1-bb39-578b1314a255-kube-api-access-gkp2j\") pod \"cert-manager-operator-controller-manager-55c444bf86-l62bf\" (UID: \"6d23fd95-6e54-47b1-bb39-578b1314a255\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" Jul 13 23:43:14.634653 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.634604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d23fd95-6e54-47b1-bb39-578b1314a255-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l62bf\" (UID: \"6d23fd95-6e54-47b1-bb39-578b1314a255\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" Jul 13 23:43:14.634968 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.634937 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkp2j\" (UniqueName: \"kubernetes.io/projected/6d23fd95-6e54-47b1-bb39-578b1314a255-kube-api-access-gkp2j\") pod \"cert-manager-operator-controller-manager-55c444bf86-l62bf\" (UID: \"6d23fd95-6e54-47b1-bb39-578b1314a255\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" Jul 13 23:43:14.635158 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.635074 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d23fd95-6e54-47b1-bb39-578b1314a255-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l62bf\" (UID: \"6d23fd95-6e54-47b1-bb39-578b1314a255\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" Jul 13 23:43:14.642875 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.642853 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkp2j\" (UniqueName: \"kubernetes.io/projected/6d23fd95-6e54-47b1-bb39-578b1314a255-kube-api-access-gkp2j\") pod \"cert-manager-operator-controller-manager-55c444bf86-l62bf\" (UID: \"6d23fd95-6e54-47b1-bb39-578b1314a255\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" Jul 13 23:43:14.715376 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.715302 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" Jul 13 23:43:14.853606 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:14.853582 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf"] Jul 13 23:43:14.855525 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:43:14.855498 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d23fd95_6e54_47b1_bb39_578b1314a255.slice/crio-431412447db359d1b8a97dbf53585e52d0feb26d30285ceb68f97947ccb4cdae WatchSource:0}: Error finding container 431412447db359d1b8a97dbf53585e52d0feb26d30285ceb68f97947ccb4cdae: Status 404 returned error can't find the container with id 431412447db359d1b8a97dbf53585e52d0feb26d30285ceb68f97947ccb4cdae Jul 13 23:43:15.598753 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:15.598717 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" event={"ID":"6d23fd95-6e54-47b1-bb39-578b1314a255","Type":"ContainerStarted","Data":"431412447db359d1b8a97dbf53585e52d0feb26d30285ceb68f97947ccb4cdae"} Jul 13 23:43:16.055709 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:16.055628 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:16.158992 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:16.158955 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:16.605133 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:16.605101 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" event={"ID":"6d23fd95-6e54-47b1-bb39-578b1314a255","Type":"ContainerStarted","Data":"986664a059908664fccac950de7d3e46a50143cc7b8a4ee04bc551659f6f428b"} Jul 13 23:43:16.638749 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:16.638690 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l62bf" podStartSLOduration=1.081842529 podStartE2EDuration="2.638675335s" totalImagesPullingTime="1.556832806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:43:16.636908706 +0000 UTC m=+229.604604556" watchObservedRunningTime="2026-07-13 23:43:16.638675335 +0000 UTC m=+229.606371185" Jul 13 23:43:17.102986 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.102955 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:17.314398 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.314367 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:17.439071 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.438994 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:17.952453 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.952415 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l"] Jul 13 23:43:17.955420 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.955400 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:17.958157 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.958137 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 23:43:17.959127 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.959108 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hzgp5\"" Jul 13 23:43:17.959220 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.959117 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 23:43:17.959508 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.959486 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgln8\" (UniqueName: \"kubernetes.io/projected/aa79d94f-287f-4278-84f3-ee722220da15-kube-api-access-vgln8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:17.959631 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.959551 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:17.959631 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.959624 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:17.965420 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:17.965397 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l"] Jul 13 23:43:18.060862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.060805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:18.061053 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.060876 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgln8\" (UniqueName: \"kubernetes.io/projected/aa79d94f-287f-4278-84f3-ee722220da15-kube-api-access-vgln8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:18.061053 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.060930 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:18.061191 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.061170 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:18.061241 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.061225 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:18.076658 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.076625 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgln8\" (UniqueName: \"kubernetes.io/projected/aa79d94f-287f-4278-84f3-ee722220da15-kube-api-access-vgln8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:18.265671 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.265584 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:18.395766 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.395741 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l"] Jul 13 23:43:18.398267 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:43:18.398237 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa79d94f_287f_4278_84f3_ee722220da15.slice/crio-13e23298829799f2cafbd7e3fa51cb020a16e35744cf38588dd429a2fe2a32bb WatchSource:0}: Error finding container 13e23298829799f2cafbd7e3fa51cb020a16e35744cf38588dd429a2fe2a32bb: Status 404 returned error can't find the container with id 13e23298829799f2cafbd7e3fa51cb020a16e35744cf38588dd429a2fe2a32bb Jul 13 23:43:18.614814 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.614779 2557 generic.go:356] "Generic (PLEG): container finished" podID="aa79d94f-287f-4278-84f3-ee722220da15" containerID="7344c39bff6ebda10386fdd9e77e18c06c76443fa10e06a46585d16a8136daa2" exitCode=0 Jul 13 23:43:18.615017 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.614864 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" event={"ID":"aa79d94f-287f-4278-84f3-ee722220da15","Type":"ContainerDied","Data":"7344c39bff6ebda10386fdd9e77e18c06c76443fa10e06a46585d16a8136daa2"} Jul 13 23:43:18.615017 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:18.614916 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" event={"ID":"aa79d94f-287f-4278-84f3-ee722220da15","Type":"ContainerStarted","Data":"13e23298829799f2cafbd7e3fa51cb020a16e35744cf38588dd429a2fe2a32bb"} Jul 13 23:43:19.614213 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.614163 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:19.806786 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.806750 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:19.914433 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.914170 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd"] Jul 13 23:43:19.917598 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.917574 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" Jul 13 23:43:19.920285 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.920259 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 23:43:19.920398 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.920345 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rxvvs\"" Jul 13 23:43:19.921217 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.921200 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 23:43:19.927891 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.927868 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd"] Jul 13 23:43:19.975036 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.975001 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad03b7a3-ce16-47a7-82c6-90a72c575e32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xf8zd\" (UID: \"ad03b7a3-ce16-47a7-82c6-90a72c575e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" Jul 13 23:43:19.975177 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:19.975067 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85l4v\" (UniqueName: \"kubernetes.io/projected/ad03b7a3-ce16-47a7-82c6-90a72c575e32-kube-api-access-85l4v\") pod \"cert-manager-cainjector-559cdd8c87-xf8zd\" (UID: \"ad03b7a3-ce16-47a7-82c6-90a72c575e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" Jul 13 23:43:20.075671 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:20.075638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad03b7a3-ce16-47a7-82c6-90a72c575e32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xf8zd\" (UID: \"ad03b7a3-ce16-47a7-82c6-90a72c575e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" Jul 13 23:43:20.075859 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:20.075730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l4v\" (UniqueName: \"kubernetes.io/projected/ad03b7a3-ce16-47a7-82c6-90a72c575e32-kube-api-access-85l4v\") pod \"cert-manager-cainjector-559cdd8c87-xf8zd\" (UID: \"ad03b7a3-ce16-47a7-82c6-90a72c575e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" Jul 13 23:43:20.092946 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:20.092899 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad03b7a3-ce16-47a7-82c6-90a72c575e32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xf8zd\" (UID: \"ad03b7a3-ce16-47a7-82c6-90a72c575e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" Jul 13 23:43:20.093555 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:20.093533 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85l4v\" (UniqueName: \"kubernetes.io/projected/ad03b7a3-ce16-47a7-82c6-90a72c575e32-kube-api-access-85l4v\") pod \"cert-manager-cainjector-559cdd8c87-xf8zd\" (UID: \"ad03b7a3-ce16-47a7-82c6-90a72c575e32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" Jul 13 23:43:20.240402 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:20.240321 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" Jul 13 23:43:20.785871 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:20.785800 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd"] Jul 13 23:43:20.788260 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:43:20.788236 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad03b7a3_ce16_47a7_82c6_90a72c575e32.slice/crio-0ca0c5859d71b500c35a787d77e464735bb5d5dcc6b68d3edc51818f57e42ae7 WatchSource:0}: Error finding container 0ca0c5859d71b500c35a787d77e464735bb5d5dcc6b68d3edc51818f57e42ae7: Status 404 returned error can't find the container with id 0ca0c5859d71b500c35a787d77e464735bb5d5dcc6b68d3edc51818f57e42ae7 Jul 13 23:43:21.630966 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:21.630919 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" event={"ID":"ad03b7a3-ce16-47a7-82c6-90a72c575e32","Type":"ContainerStarted","Data":"0ca0c5859d71b500c35a787d77e464735bb5d5dcc6b68d3edc51818f57e42ae7"} Jul 13 23:43:21.633149 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:21.633121 2557 generic.go:356] "Generic (PLEG): container finished" podID="aa79d94f-287f-4278-84f3-ee722220da15" containerID="caa784b1c4ed8defaf200622a6be284c5f0426135c1f52fea88991fef5c096fb" exitCode=0 Jul 13 23:43:21.633327 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:21.633182 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" event={"ID":"aa79d94f-287f-4278-84f3-ee722220da15","Type":"ContainerDied","Data":"caa784b1c4ed8defaf200622a6be284c5f0426135c1f52fea88991fef5c096fb"} Jul 13 23:43:22.641130 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:22.641093 2557 generic.go:356] "Generic (PLEG): container finished" podID="aa79d94f-287f-4278-84f3-ee722220da15" containerID="3472baf423023c7d6f675ccb526878e06446c213e8a5e0f8a2787cd01301bf02" exitCode=0 Jul 13 23:43:22.641586 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:22.641197 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" event={"ID":"aa79d94f-287f-4278-84f3-ee722220da15","Type":"ContainerDied","Data":"3472baf423023c7d6f675ccb526878e06446c213e8a5e0f8a2787cd01301bf02"} Jul 13 23:43:22.837366 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:22.837328 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:22.938210 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:22.938124 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:23.647606 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.647512 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" event={"ID":"ad03b7a3-ce16-47a7-82c6-90a72c575e32","Type":"ContainerStarted","Data":"c0d2949503ae66cb7d3d42f1610889b5c4b07ba3290c7d0edbace724bc943510"} Jul 13 23:43:23.663253 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.663197 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xf8zd" podStartSLOduration=2.102472326 podStartE2EDuration="4.663178736s" totalImagesPullingTime="2.56070641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:43:23.662091804 +0000 UTC m=+236.629787655" watchObservedRunningTime="2026-07-13 23:43:23.663178736 +0000 UTC m=+236.630874585" Jul 13 23:43:23.792140 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.792115 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:23.806932 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.806912 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-bundle\") pod \"aa79d94f-287f-4278-84f3-ee722220da15\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " Jul 13 23:43:23.807037 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.806992 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgln8\" (UniqueName: \"kubernetes.io/projected/aa79d94f-287f-4278-84f3-ee722220da15-kube-api-access-vgln8\") pod \"aa79d94f-287f-4278-84f3-ee722220da15\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " Jul 13 23:43:23.807037 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.807010 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-util\") pod \"aa79d94f-287f-4278-84f3-ee722220da15\" (UID: \"aa79d94f-287f-4278-84f3-ee722220da15\") " Jul 13 23:43:23.807228 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.807207 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-bundle" (OuterVolumeSpecName: "bundle") pod "aa79d94f-287f-4278-84f3-ee722220da15" (UID: "aa79d94f-287f-4278-84f3-ee722220da15"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:43:23.809009 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.808976 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa79d94f-287f-4278-84f3-ee722220da15-kube-api-access-vgln8" (OuterVolumeSpecName: "kube-api-access-vgln8") pod "aa79d94f-287f-4278-84f3-ee722220da15" (UID: "aa79d94f-287f-4278-84f3-ee722220da15"). InnerVolumeSpecName "kube-api-access-vgln8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:43:23.880040 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.879987 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-util" (OuterVolumeSpecName: "util") pod "aa79d94f-287f-4278-84f3-ee722220da15" (UID: "aa79d94f-287f-4278-84f3-ee722220da15"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:43:23.908323 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.908276 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:23.908323 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.908304 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgln8\" (UniqueName: \"kubernetes.io/projected/aa79d94f-287f-4278-84f3-ee722220da15-kube-api-access-vgln8\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:23.908323 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:23.908316 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa79d94f-287f-4278-84f3-ee722220da15-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:24.653918 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.653865 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" event={"ID":"aa79d94f-287f-4278-84f3-ee722220da15","Type":"ContainerDied","Data":"13e23298829799f2cafbd7e3fa51cb020a16e35744cf38588dd429a2fe2a32bb"} Jul 13 23:43:24.653918 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.653894 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbr8l" Jul 13 23:43:24.653918 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.653920 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13e23298829799f2cafbd7e3fa51cb020a16e35744cf38588dd429a2fe2a32bb" Jul 13 23:43:24.708051 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.708022 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6zb7k"] Jul 13 23:43:24.708341 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.708328 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa79d94f-287f-4278-84f3-ee722220da15" containerName="util" Jul 13 23:43:24.708379 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.708343 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa79d94f-287f-4278-84f3-ee722220da15" containerName="util" Jul 13 23:43:24.708379 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.708351 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa79d94f-287f-4278-84f3-ee722220da15" containerName="extract" Jul 13 23:43:24.708379 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.708357 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa79d94f-287f-4278-84f3-ee722220da15" containerName="extract" Jul 13 23:43:24.708379 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.708370 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa79d94f-287f-4278-84f3-ee722220da15" containerName="pull" Jul 13 23:43:24.708379 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.708376 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa79d94f-287f-4278-84f3-ee722220da15" containerName="pull" Jul 13 23:43:24.708519 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.708446 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa79d94f-287f-4278-84f3-ee722220da15" containerName="extract" Jul 13 23:43:24.710378 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.710358 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:24.712837 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.712803 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hvb4n\"" Jul 13 23:43:24.719055 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.719037 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6zb7k"] Jul 13 23:43:24.816398 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.816360 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hhqh\" (UniqueName: \"kubernetes.io/projected/00a99dcc-832b-4cf1-b26d-51c26b2bc1cf-kube-api-access-2hhqh\") pod \"cert-manager-webhook-6486ffd997-6zb7k\" (UID: \"00a99dcc-832b-4cf1-b26d-51c26b2bc1cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:24.816567 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.816408 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00a99dcc-832b-4cf1-b26d-51c26b2bc1cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6zb7k\" (UID: \"00a99dcc-832b-4cf1-b26d-51c26b2bc1cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:24.917754 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.917666 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hhqh\" (UniqueName: \"kubernetes.io/projected/00a99dcc-832b-4cf1-b26d-51c26b2bc1cf-kube-api-access-2hhqh\") pod \"cert-manager-webhook-6486ffd997-6zb7k\" (UID: \"00a99dcc-832b-4cf1-b26d-51c26b2bc1cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:24.917754 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.917707 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00a99dcc-832b-4cf1-b26d-51c26b2bc1cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6zb7k\" (UID: \"00a99dcc-832b-4cf1-b26d-51c26b2bc1cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:24.925421 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.925396 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00a99dcc-832b-4cf1-b26d-51c26b2bc1cf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6zb7k\" (UID: \"00a99dcc-832b-4cf1-b26d-51c26b2bc1cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:24.925554 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:24.925536 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hhqh\" (UniqueName: \"kubernetes.io/projected/00a99dcc-832b-4cf1-b26d-51c26b2bc1cf-kube-api-access-2hhqh\") pod \"cert-manager-webhook-6486ffd997-6zb7k\" (UID: \"00a99dcc-832b-4cf1-b26d-51c26b2bc1cf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:25.019616 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:25.019581 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:25.142913 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:25.142888 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6zb7k"] Jul 13 23:43:25.145081 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:43:25.145054 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00a99dcc_832b_4cf1_b26d_51c26b2bc1cf.slice/crio-aa665bbfa5be51837b582de0bca67b022080de86b2c7a68cac744e3f9ffd17b8 WatchSource:0}: Error finding container aa665bbfa5be51837b582de0bca67b022080de86b2c7a68cac744e3f9ffd17b8: Status 404 returned error can't find the container with id aa665bbfa5be51837b582de0bca67b022080de86b2c7a68cac744e3f9ffd17b8 Jul 13 23:43:25.660304 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:25.660271 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" event={"ID":"00a99dcc-832b-4cf1-b26d-51c26b2bc1cf","Type":"ContainerStarted","Data":"b3f050a78ff1eec680bd861be78c34566fade14369b83f67fa4323e90d7a993b"} Jul 13 23:43:25.660669 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:25.660312 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" event={"ID":"00a99dcc-832b-4cf1-b26d-51c26b2bc1cf","Type":"ContainerStarted","Data":"aa665bbfa5be51837b582de0bca67b022080de86b2c7a68cac744e3f9ffd17b8"} Jul 13 23:43:25.660669 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:25.660346 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:25.677878 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:25.677815 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" podStartSLOduration=1.6777978789999999 podStartE2EDuration="1.677797879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:43:25.676222197 +0000 UTC m=+238.643918064" watchObservedRunningTime="2026-07-13 23:43:25.677797879 +0000 UTC m=+238.645493728" Jul 13 23:43:26.251170 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:26.251135 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:26.350974 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:26.350937 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:27.192192 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:27.192154 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:28.016605 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.016569 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-78ft2"] Jul 13 23:43:28.022520 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.022500 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-78ft2" Jul 13 23:43:28.025609 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.025585 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-z5nz8\"" Jul 13 23:43:28.030606 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.030573 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-78ft2"] Jul 13 23:43:28.043255 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.043230 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78nc\" (UniqueName: \"kubernetes.io/projected/6b645913-6a8c-4458-8d63-eebc010813bc-kube-api-access-t78nc\") pod \"cert-manager-55b4d954d5-78ft2\" (UID: \"6b645913-6a8c-4458-8d63-eebc010813bc\") " pod="cert-manager/cert-manager-55b4d954d5-78ft2" Jul 13 23:43:28.043382 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.043274 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b645913-6a8c-4458-8d63-eebc010813bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-78ft2\" (UID: \"6b645913-6a8c-4458-8d63-eebc010813bc\") " pod="cert-manager/cert-manager-55b4d954d5-78ft2" Jul 13 23:43:28.144682 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.144645 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t78nc\" (UniqueName: \"kubernetes.io/projected/6b645913-6a8c-4458-8d63-eebc010813bc-kube-api-access-t78nc\") pod \"cert-manager-55b4d954d5-78ft2\" (UID: \"6b645913-6a8c-4458-8d63-eebc010813bc\") " pod="cert-manager/cert-manager-55b4d954d5-78ft2" Jul 13 23:43:28.144682 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.144679 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b645913-6a8c-4458-8d63-eebc010813bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-78ft2\" (UID: \"6b645913-6a8c-4458-8d63-eebc010813bc\") " pod="cert-manager/cert-manager-55b4d954d5-78ft2" Jul 13 23:43:28.153115 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.153088 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b645913-6a8c-4458-8d63-eebc010813bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-78ft2\" (UID: \"6b645913-6a8c-4458-8d63-eebc010813bc\") " pod="cert-manager/cert-manager-55b4d954d5-78ft2" Jul 13 23:43:28.153241 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.153222 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78nc\" (UniqueName: \"kubernetes.io/projected/6b645913-6a8c-4458-8d63-eebc010813bc-kube-api-access-t78nc\") pod \"cert-manager-55b4d954d5-78ft2\" (UID: \"6b645913-6a8c-4458-8d63-eebc010813bc\") " pod="cert-manager/cert-manager-55b4d954d5-78ft2" Jul 13 23:43:28.279842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.279753 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w"] Jul 13 23:43:28.283795 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.283769 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" Jul 13 23:43:28.286456 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.286433 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 23:43:28.286456 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.286446 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8pbvc\"" Jul 13 23:43:28.286584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.286504 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 23:43:28.290208 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.290188 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w"] Jul 13 23:43:28.332695 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.332661 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-78ft2" Jul 13 23:43:28.346761 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.346728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d84143-88bf-42fd-aaa1-e02f98c69b14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pc85w\" (UID: \"36d84143-88bf-42fd-aaa1-e02f98c69b14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" Jul 13 23:43:28.346909 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.346814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6nmn\" (UniqueName: \"kubernetes.io/projected/36d84143-88bf-42fd-aaa1-e02f98c69b14-kube-api-access-n6nmn\") pod \"openshift-lws-operator-fd8ccff4c-pc85w\" (UID: \"36d84143-88bf-42fd-aaa1-e02f98c69b14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" Jul 13 23:43:28.447608 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.447562 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6nmn\" (UniqueName: \"kubernetes.io/projected/36d84143-88bf-42fd-aaa1-e02f98c69b14-kube-api-access-n6nmn\") pod \"openshift-lws-operator-fd8ccff4c-pc85w\" (UID: \"36d84143-88bf-42fd-aaa1-e02f98c69b14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" Jul 13 23:43:28.447774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.447670 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d84143-88bf-42fd-aaa1-e02f98c69b14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pc85w\" (UID: \"36d84143-88bf-42fd-aaa1-e02f98c69b14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" Jul 13 23:43:28.448082 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.448064 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d84143-88bf-42fd-aaa1-e02f98c69b14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pc85w\" (UID: \"36d84143-88bf-42fd-aaa1-e02f98c69b14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" Jul 13 23:43:28.455568 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.455546 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6nmn\" (UniqueName: \"kubernetes.io/projected/36d84143-88bf-42fd-aaa1-e02f98c69b14-kube-api-access-n6nmn\") pod \"openshift-lws-operator-fd8ccff4c-pc85w\" (UID: \"36d84143-88bf-42fd-aaa1-e02f98c69b14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" Jul 13 23:43:28.460122 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.460100 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-78ft2"] Jul 13 23:43:28.462532 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:43:28.462491 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b645913_6a8c_4458_8d63_eebc010813bc.slice/crio-53877eadd65098fd66db4a9deff6f453638e7c2639a314b2d16a3ece46c2fa4f WatchSource:0}: Error finding container 53877eadd65098fd66db4a9deff6f453638e7c2639a314b2d16a3ece46c2fa4f: Status 404 returned error can't find the container with id 53877eadd65098fd66db4a9deff6f453638e7c2639a314b2d16a3ece46c2fa4f Jul 13 23:43:28.594788 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.594751 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" Jul 13 23:43:28.675216 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.674748 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-78ft2" event={"ID":"6b645913-6a8c-4458-8d63-eebc010813bc","Type":"ContainerStarted","Data":"33e0724b4523a4218bddec92fd477bb4ff04cc2ee97ab4df82350a573c5de1be"} Jul 13 23:43:28.675216 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.674812 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-78ft2" event={"ID":"6b645913-6a8c-4458-8d63-eebc010813bc","Type":"ContainerStarted","Data":"53877eadd65098fd66db4a9deff6f453638e7c2639a314b2d16a3ece46c2fa4f"} Jul 13 23:43:28.695127 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.695079 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-78ft2" podStartSLOduration=1.6950604089999999 podStartE2EDuration="1.695060409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:43:28.692005084 +0000 UTC m=+241.659700936" watchObservedRunningTime="2026-07-13 23:43:28.695060409 +0000 UTC m=+241.662756258" Jul 13 23:43:28.726632 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:28.726602 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w"] Jul 13 23:43:28.728592 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:43:28.728563 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36d84143_88bf_42fd_aaa1_e02f98c69b14.slice/crio-fd936ca8f84b93da3a9c67d2b3632684cefb66e1a4955af46ae2e5d2d5984bb0 WatchSource:0}: Error finding container fd936ca8f84b93da3a9c67d2b3632684cefb66e1a4955af46ae2e5d2d5984bb0: Status 404 returned error can't find the container with id fd936ca8f84b93da3a9c67d2b3632684cefb66e1a4955af46ae2e5d2d5984bb0 Jul 13 23:43:29.681166 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:29.681128 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" event={"ID":"36d84143-88bf-42fd-aaa1-e02f98c69b14","Type":"ContainerStarted","Data":"fd936ca8f84b93da3a9c67d2b3632684cefb66e1a4955af46ae2e5d2d5984bb0"} Jul 13 23:43:30.689735 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:30.689643 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" event={"ID":"36d84143-88bf-42fd-aaa1-e02f98c69b14","Type":"ContainerStarted","Data":"460bc31c121bd14438227b6bbc4b1e6848300290034ca54822486011e5209c5b"} Jul 13 23:43:30.705342 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:30.705297 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pc85w" podStartSLOduration=1.018271123 podStartE2EDuration="2.705282687s" totalImagesPullingTime="1.687011564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:43:30.704975339 +0000 UTC m=+243.672671188" watchObservedRunningTime="2026-07-13 23:43:30.705282687 +0000 UTC m=+243.672978536" Jul 13 23:43:31.413058 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:31.413018 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:31.492670 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:31.492642 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:31.667330 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:31.667255 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6zb7k" Jul 13 23:43:33.382514 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.382477 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t"] Jul 13 23:43:33.413445 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.413411 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t"] Jul 13 23:43:33.413592 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.413519 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.416170 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.416145 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hzgp5\"" Jul 13 23:43:33.416170 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.416163 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 23:43:33.417201 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.417186 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 23:43:33.492115 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.492074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.492115 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.492118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.492339 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.492177 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6552\" (UniqueName: \"kubernetes.io/projected/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-kube-api-access-t6552\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.593583 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.593546 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.593583 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.593591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6552\" (UniqueName: \"kubernetes.io/projected/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-kube-api-access-t6552\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.593814 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.593663 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.594002 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.593972 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.594103 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.594027 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.601269 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.601248 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6552\" (UniqueName: \"kubernetes.io/projected/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-kube-api-access-t6552\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.688273 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.688206 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:33.722636 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.722606 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:33.867722 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:33.867693 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t"] Jul 13 23:43:33.869303 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:43:33.869278 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacbc653_2e2d_4f0d_9cdc_2622d7859f2a.slice/crio-a962b38d9555c3f7c94e36bf9fdbe526b5058e028ebc02a2c3f20c1060922d67 WatchSource:0}: Error finding container a962b38d9555c3f7c94e36bf9fdbe526b5058e028ebc02a2c3f20c1060922d67: Status 404 returned error can't find the container with id a962b38d9555c3f7c94e36bf9fdbe526b5058e028ebc02a2c3f20c1060922d67 Jul 13 23:43:34.709424 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:34.709392 2557 generic.go:356] "Generic (PLEG): container finished" podID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerID="4ac43eb70ef7bd04852f452f9163a6644c1e143534ebefcdf3851e48642a43c3" exitCode=0 Jul 13 23:43:34.709789 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:34.709436 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" event={"ID":"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a","Type":"ContainerDied","Data":"4ac43eb70ef7bd04852f452f9163a6644c1e143534ebefcdf3851e48642a43c3"} Jul 13 23:43:34.709789 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:34.709471 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" event={"ID":"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a","Type":"ContainerStarted","Data":"a962b38d9555c3f7c94e36bf9fdbe526b5058e028ebc02a2c3f20c1060922d67"} Jul 13 23:43:36.721074 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:36.721040 2557 generic.go:356] "Generic (PLEG): container finished" podID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerID="3d98b414042bfe788302598a984a33778a029912c0a524afc30a31de137a2238" exitCode=0 Jul 13 23:43:36.721448 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:36.721101 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" event={"ID":"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a","Type":"ContainerDied","Data":"3d98b414042bfe788302598a984a33778a029912c0a524afc30a31de137a2238"} Jul 13 23:43:37.727314 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:37.727280 2557 generic.go:356] "Generic (PLEG): container finished" podID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerID="cd80d42b8188fa1c2fb3e0596a06630ffa1ff01704603c8a989cfa236f736f48" exitCode=0 Jul 13 23:43:37.727955 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:37.727359 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" event={"ID":"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a","Type":"ContainerDied","Data":"cd80d42b8188fa1c2fb3e0596a06630ffa1ff01704603c8a989cfa236f736f48"} Jul 13 23:43:38.867846 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:38.867812 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:38.939068 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:38.939037 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-bundle\") pod \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " Jul 13 23:43:38.939303 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:38.939117 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6552\" (UniqueName: \"kubernetes.io/projected/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-kube-api-access-t6552\") pod \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " Jul 13 23:43:38.939303 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:38.939139 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-util\") pod \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\" (UID: \"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a\") " Jul 13 23:43:38.939969 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:38.939941 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-bundle" (OuterVolumeSpecName: "bundle") pod "cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" (UID: "cacbc653-2e2d-4f0d-9cdc-2622d7859f2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:43:38.941196 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:38.941166 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-kube-api-access-t6552" (OuterVolumeSpecName: "kube-api-access-t6552") pod "cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" (UID: "cacbc653-2e2d-4f0d-9cdc-2622d7859f2a"). InnerVolumeSpecName "kube-api-access-t6552". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:43:38.948139 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:38.948112 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-util" (OuterVolumeSpecName: "util") pod "cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" (UID: "cacbc653-2e2d-4f0d-9cdc-2622d7859f2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:43:39.040415 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:39.040337 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:39.040415 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:39.040364 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6552\" (UniqueName: \"kubernetes.io/projected/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-kube-api-access-t6552\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:39.040415 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:39.040373 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacbc653-2e2d-4f0d-9cdc-2622d7859f2a-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:43:39.737557 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:39.737514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" event={"ID":"cacbc653-2e2d-4f0d-9cdc-2622d7859f2a","Type":"ContainerDied","Data":"a962b38d9555c3f7c94e36bf9fdbe526b5058e028ebc02a2c3f20c1060922d67"} Jul 13 23:43:39.737716 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:39.737571 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a962b38d9555c3f7c94e36bf9fdbe526b5058e028ebc02a2c3f20c1060922d67" Jul 13 23:43:39.737716 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:39.737525 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdqg2t" Jul 13 23:43:51.858443 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:51.858365 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:51.963891 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:51.963857 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:52.682114 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:52.682081 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:52.895981 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:52.895946 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.004184 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.004104 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.061528 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.061488 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f"] Jul 13 23:43:53.062020 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.062001 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerName="util" Jul 13 23:43:53.062083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.062023 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerName="util" Jul 13 23:43:53.062083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.062040 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerName="pull" Jul 13 23:43:53.062083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.062049 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerName="pull" Jul 13 23:43:53.062083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.062072 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerName="extract" Jul 13 23:43:53.062083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.062080 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerName="extract" Jul 13 23:43:53.062232 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.062174 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cacbc653-2e2d-4f0d-9cdc-2622d7859f2a" containerName="extract" Jul 13 23:43:53.064658 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.064633 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.067237 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.067214 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x2sjv\"" Jul 13 23:43:53.067718 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.067699 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 23:43:53.067998 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.067981 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 23:43:53.068144 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.067983 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 23:43:53.068264 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.068231 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 23:43:53.092615 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.092588 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f"] Jul 13 23:43:53.164540 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.164501 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2154df9d-c366-4174-a435-57468717df82-tmp\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.164774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.164570 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2154df9d-c366-4174-a435-57468717df82-manifests\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.164774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.164607 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnnr\" (UniqueName: \"kubernetes.io/projected/2154df9d-c366-4174-a435-57468717df82-kube-api-access-lgnnr\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.164774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.164637 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2154df9d-c366-4174-a435-57468717df82-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.164774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.164670 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2154df9d-c366-4174-a435-57468717df82-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.219700 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.219667 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.265642 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.265556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2154df9d-c366-4174-a435-57468717df82-manifests\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.265642 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.265602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnnr\" (UniqueName: \"kubernetes.io/projected/2154df9d-c366-4174-a435-57468717df82-kube-api-access-lgnnr\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.265642 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.265634 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2154df9d-c366-4174-a435-57468717df82-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.266007 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.265651 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2154df9d-c366-4174-a435-57468717df82-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.266007 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.265688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2154df9d-c366-4174-a435-57468717df82-tmp\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.266116 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.266038 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2154df9d-c366-4174-a435-57468717df82-manifests\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.268074 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.268041 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2154df9d-c366-4174-a435-57468717df82-tmp\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.268231 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.268211 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2154df9d-c366-4174-a435-57468717df82-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.268275 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.268213 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2154df9d-c366-4174-a435-57468717df82-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.275097 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.275069 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnnr\" (UniqueName: \"kubernetes.io/projected/2154df9d-c366-4174-a435-57468717df82-kube-api-access-lgnnr\") pod \"opendatahub-operator-controller-manager-74bf4db56c-8np9f\" (UID: \"2154df9d-c366-4174-a435-57468717df82\") " pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.323946 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.323917 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.376854 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.376811 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:53.445060 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.445026 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.513137 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.513100 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.519584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.519165 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f"] Jul 13 23:43:53.575227 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.575199 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.675728 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.675695 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.776911 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.776810 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.806996 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.806963 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" event={"ID":"2154df9d-c366-4174-a435-57468717df82","Type":"ContainerStarted","Data":"b51ad4ef3f45b0773a481da47f2bd62aaa7577e690c75707c8f70e946851a333"} Jul 13 23:43:53.877048 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.877005 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:53.980158 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:53.980127 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:55.255979 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:55.255940 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:43:56.825178 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:56.825138 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" event={"ID":"2154df9d-c366-4174-a435-57468717df82","Type":"ContainerStarted","Data":"28f820d2d083eb8be626cfcf06d07ceae83f63dcc057a8b6e118d8d988f68054"} Jul 13 23:43:57.831810 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:57.831778 2557 generic.go:356] "Generic (PLEG): container finished" podID="2154df9d-c366-4174-a435-57468717df82" containerID="28f820d2d083eb8be626cfcf06d07ceae83f63dcc057a8b6e118d8d988f68054" exitCode=0 Jul 13 23:43:57.832211 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:57.831862 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" event={"ID":"2154df9d-c366-4174-a435-57468717df82","Type":"ContainerDied","Data":"28f820d2d083eb8be626cfcf06d07ceae83f63dcc057a8b6e118d8d988f68054"} Jul 13 23:43:58.840253 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:58.840215 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" event={"ID":"2154df9d-c366-4174-a435-57468717df82","Type":"ContainerStarted","Data":"0dedcc5a4cd939fa11c72bb2f6da90e8a52232ea30297db4c55461cb198beb99"} Jul 13 23:43:58.840725 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:58.840358 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:43:58.864735 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:58.864672 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" podStartSLOduration=1.603056576 podStartE2EDuration="5.864651125s" totalImagesPullingTime="3.190243417s" totalInitContainerRuntime="1.071351132s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:43:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:43:58.861751907 +0000 UTC m=+271.829447770" watchObservedRunningTime="2026-07-13 23:43:58.864651125 +0000 UTC m=+271.832346977" Jul 13 23:43:59.932327 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:43:59.932290 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:00.040784 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:00.040752 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:06.182258 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:06.182227 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:09.848972 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:09.848940 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74bf4db56c-8np9f" Jul 13 23:44:10.578136 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:10.578100 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:11.894266 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:11.894211 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:12.029606 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.029529 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:12.130499 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.130468 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:12.493767 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.493734 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:12.603751 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.603718 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg"] Jul 13 23:44:12.609082 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.609062 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.611915 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.611882 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 23:44:12.611915 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.611905 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-d5jbc\"" Jul 13 23:44:12.612056 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.611944 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 23:44:12.612056 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.611908 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 23:44:12.612928 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.612907 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 23:44:12.628059 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.628030 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg"] Jul 13 23:44:12.635516 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.635489 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsjvn\" (UniqueName: \"kubernetes.io/projected/0aaec899-c97e-4795-9e85-29bb6b4c949b-kube-api-access-xsjvn\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.635662 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.635529 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0aaec899-c97e-4795-9e85-29bb6b4c949b-tls-certs\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.635662 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.635601 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0aaec899-c97e-4795-9e85-29bb6b4c949b-tmp\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.736091 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.736053 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0aaec899-c97e-4795-9e85-29bb6b4c949b-tmp\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.736250 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.736141 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsjvn\" (UniqueName: \"kubernetes.io/projected/0aaec899-c97e-4795-9e85-29bb6b4c949b-kube-api-access-xsjvn\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.736250 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.736182 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0aaec899-c97e-4795-9e85-29bb6b4c949b-tls-certs\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.738398 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.738377 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0aaec899-c97e-4795-9e85-29bb6b4c949b-tmp\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.738627 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.738609 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0aaec899-c97e-4795-9e85-29bb6b4c949b-tls-certs\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.749844 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.749774 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsjvn\" (UniqueName: \"kubernetes.io/projected/0aaec899-c97e-4795-9e85-29bb6b4c949b-kube-api-access-xsjvn\") pod \"kube-auth-proxy-764dccbb5b-lbfgg\" (UID: \"0aaec899-c97e-4795-9e85-29bb6b4c949b\") " pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:12.835955 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.835915 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:12.918551 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:12.918520 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" Jul 13 23:44:13.073063 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:13.073026 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:13.076900 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:13.076868 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg"] Jul 13 23:44:13.080957 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:44:13.080903 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aaec899_c97e_4795_9e85_29bb6b4c949b.slice/crio-9395471752a134b504af23a874592498773928ca06bc66bd6e838a93d82329f4 WatchSource:0}: Error finding container 9395471752a134b504af23a874592498773928ca06bc66bd6e838a93d82329f4: Status 404 returned error can't find the container with id 9395471752a134b504af23a874592498773928ca06bc66bd6e838a93d82329f4 Jul 13 23:44:13.177924 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:13.177883 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:13.274292 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:13.274213 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:13.513736 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:13.513690 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:13.915069 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:13.915034 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" event={"ID":"0aaec899-c97e-4795-9e85-29bb6b4c949b","Type":"ContainerStarted","Data":"9395471752a134b504af23a874592498773928ca06bc66bd6e838a93d82329f4"} Jul 13 23:44:14.104355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.104320 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s54cz"] Jul 13 23:44:14.107093 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.107062 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:14.113539 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.113514 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 13 23:44:14.148734 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.148701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fgjx\" (UniqueName: \"kubernetes.io/projected/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-kube-api-access-7fgjx\") pod \"model-serving-api-54d89bd5fc-s54cz\" (UID: \"a8e0d9d3-2734-4ded-be8c-6fa4f8186874\") " pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:14.148977 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.148746 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-tls-certs\") pod \"model-serving-api-54d89bd5fc-s54cz\" (UID: \"a8e0d9d3-2734-4ded-be8c-6fa4f8186874\") " pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:14.167862 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.167768 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s54cz"] Jul 13 23:44:14.193903 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.193863 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:14.250808 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.250416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fgjx\" (UniqueName: \"kubernetes.io/projected/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-kube-api-access-7fgjx\") pod \"model-serving-api-54d89bd5fc-s54cz\" (UID: \"a8e0d9d3-2734-4ded-be8c-6fa4f8186874\") " pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:14.250808 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.250461 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-tls-certs\") pod \"model-serving-api-54d89bd5fc-s54cz\" (UID: \"a8e0d9d3-2734-4ded-be8c-6fa4f8186874\") " pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:14.250808 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:44:14.250619 2557 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 13 23:44:14.250808 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:44:14.250697 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-tls-certs podName:a8e0d9d3-2734-4ded-be8c-6fa4f8186874 nodeName:}" failed. No retries permitted until 2026-07-13 23:44:14.750675289 +0000 UTC m=+287.718371141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-tls-certs") pod "model-serving-api-54d89bd5fc-s54cz" (UID: "a8e0d9d3-2734-4ded-be8c-6fa4f8186874") : secret "model-serving-api-tls" not found Jul 13 23:44:14.265344 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.265318 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fgjx\" (UniqueName: \"kubernetes.io/projected/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-kube-api-access-7fgjx\") pod \"model-serving-api-54d89bd5fc-s54cz\" (UID: \"a8e0d9d3-2734-4ded-be8c-6fa4f8186874\") " pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:14.336492 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.336443 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:14.433906 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.433803 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:14.534467 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.534436 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:14.755178 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.755090 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-tls-certs\") pod \"model-serving-api-54d89bd5fc-s54cz\" (UID: \"a8e0d9d3-2734-4ded-be8c-6fa4f8186874\") " pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:14.757600 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:14.757575 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e0d9d3-2734-4ded-be8c-6fa4f8186874-tls-certs\") pod \"model-serving-api-54d89bd5fc-s54cz\" (UID: \"a8e0d9d3-2734-4ded-be8c-6fa4f8186874\") " pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:15.020993 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:15.020900 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:15.166244 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:15.166215 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s54cz"] Jul 13 23:44:15.293789 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:15.293701 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:15.803167 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:44:15.803134 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e0d9d3_2734_4ded_be8c_6fa4f8186874.slice/crio-2a93bf22176b72fe7527ccc609df567ea3748eb01b50eb61e2287649972c052c WatchSource:0}: Error finding container 2a93bf22176b72fe7527ccc609df567ea3748eb01b50eb61e2287649972c052c: Status 404 returned error can't find the container with id 2a93bf22176b72fe7527ccc609df567ea3748eb01b50eb61e2287649972c052c Jul 13 23:44:15.926506 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:15.926474 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" event={"ID":"0aaec899-c97e-4795-9e85-29bb6b4c949b","Type":"ContainerStarted","Data":"2e5cd384826226606809030dac29ed7593ed251450e8aba477f1f3473aff33a1"} Jul 13 23:44:15.927593 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:15.927569 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" event={"ID":"a8e0d9d3-2734-4ded-be8c-6fa4f8186874","Type":"ContainerStarted","Data":"2a93bf22176b72fe7527ccc609df567ea3748eb01b50eb61e2287649972c052c"} Jul 13 23:44:15.945887 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:15.945833 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-764dccbb5b-lbfgg" podStartSLOduration=1.2007364680000001 podStartE2EDuration="3.945795497s" totalImagesPullingTime="2.745059029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:44:15.9430349 +0000 UTC m=+288.910730746" watchObservedRunningTime="2026-07-13 23:44:15.945795497 +0000 UTC m=+288.913491347" Jul 13 23:44:17.939549 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:17.939443 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" event={"ID":"a8e0d9d3-2734-4ded-be8c-6fa4f8186874","Type":"ContainerStarted","Data":"037b24df1614bc7357567738cd8920434c7bcffaed0b9b1e9765ea10ea41b08f"} Jul 13 23:44:17.939946 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:17.939661 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:17.957750 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:17.957693 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" podStartSLOduration=2.100818846 podStartE2EDuration="3.957674398s" totalImagesPullingTime="1.856855552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:44:17.95456134 +0000 UTC m=+290.922257225" watchObservedRunningTime="2026-07-13 23:44:17.957674398 +0000 UTC m=+290.925370249" Jul 13 23:44:19.192212 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:19.192176 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:19.293891 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:19.293856 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:19.575350 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:19.575314 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:19.746650 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:19.746614 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:19.859427 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:19.859343 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:20.351536 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.351500 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh"] Jul 13 23:44:20.354766 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.354749 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.358374 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.358351 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 23:44:20.359386 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.359354 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hbncl\"" Jul 13 23:44:20.359489 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.359371 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 23:44:20.359489 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.359416 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 23:44:20.365356 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.365332 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh"] Jul 13 23:44:20.406303 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.406272 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcc5g\" (UniqueName: \"kubernetes.io/projected/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-kube-api-access-lcc5g\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.406475 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.406332 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-metrics-cert\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.406475 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.406362 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-manager-config\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.406475 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.406383 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-cert\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.507253 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.507216 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcc5g\" (UniqueName: \"kubernetes.io/projected/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-kube-api-access-lcc5g\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.507439 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.507283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-metrics-cert\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.507439 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.507313 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-manager-config\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.507439 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.507336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-cert\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.508135 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.508109 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-manager-config\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.509868 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.509847 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-metrics-cert\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.509950 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.509897 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-cert\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.515519 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.515495 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcc5g\" (UniqueName: \"kubernetes.io/projected/4c1ccc35-bcb1-4a2e-aad8-855cef898ce6-kube-api-access-lcc5g\") pod \"lws-controller-manager-5dc78dff7b-594xh\" (UID: \"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6\") " pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.666131 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.666058 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:20.796757 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.796732 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh"] Jul 13 23:44:20.798670 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:44:20.798635 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1ccc35_bcb1_4a2e_aad8_855cef898ce6.slice/crio-61058c3da9ba85500351b60d8daf7941766ffac53e97523e9156fb41dffae81c WatchSource:0}: Error finding container 61058c3da9ba85500351b60d8daf7941766ffac53e97523e9156fb41dffae81c: Status 404 returned error can't find the container with id 61058c3da9ba85500351b60d8daf7941766ffac53e97523e9156fb41dffae81c Jul 13 23:44:20.958042 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:20.957956 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" event={"ID":"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6","Type":"ContainerStarted","Data":"61058c3da9ba85500351b60d8daf7941766ffac53e97523e9156fb41dffae81c"} Jul 13 23:44:22.970060 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:22.970022 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" event={"ID":"4c1ccc35-bcb1-4a2e-aad8-855cef898ce6","Type":"ContainerStarted","Data":"a3b74205d2ff677ccedc0f33ce0c6019061624e5c394ad49dd40a123f69617d2"} Jul 13 23:44:22.970562 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:22.970115 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:22.995334 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:22.995287 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" podStartSLOduration=1.266439224 podStartE2EDuration="2.995273037s" totalImagesPullingTime="1.728833813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:44:22.992938805 +0000 UTC m=+295.960634665" watchObservedRunningTime="2026-07-13 23:44:22.995273037 +0000 UTC m=+295.962968887" Jul 13 23:44:23.357842 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.357788 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:23.521175 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.521140 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wpl64"] Jul 13 23:44:23.524805 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.524782 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:23.528871 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.528848 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 13 23:44:23.530636 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.530608 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:23.530741 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.530713 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xjkkn\"" Jul 13 23:44:23.549188 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.549164 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wpl64"] Jul 13 23:44:23.617879 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.617786 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:23.636109 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.636084 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkml\" (UniqueName: \"kubernetes.io/projected/5930f51d-da11-4478-999e-c97def8f38ce-kube-api-access-zkkml\") pod \"kserve-controller-manager-d6f4b65b8-wpl64\" (UID: \"5930f51d-da11-4478-999e-c97def8f38ce\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:23.636322 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.636302 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5930f51d-da11-4478-999e-c97def8f38ce-cert\") pod \"kserve-controller-manager-d6f4b65b8-wpl64\" (UID: \"5930f51d-da11-4478-999e-c97def8f38ce\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:23.737525 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.737491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkml\" (UniqueName: \"kubernetes.io/projected/5930f51d-da11-4478-999e-c97def8f38ce-kube-api-access-zkkml\") pod \"kserve-controller-manager-d6f4b65b8-wpl64\" (UID: \"5930f51d-da11-4478-999e-c97def8f38ce\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:23.737678 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.737556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5930f51d-da11-4478-999e-c97def8f38ce-cert\") pod \"kserve-controller-manager-d6f4b65b8-wpl64\" (UID: \"5930f51d-da11-4478-999e-c97def8f38ce\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:23.739956 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.739928 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5930f51d-da11-4478-999e-c97def8f38ce-cert\") pod \"kserve-controller-manager-d6f4b65b8-wpl64\" (UID: \"5930f51d-da11-4478-999e-c97def8f38ce\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:23.749475 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.749452 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkml\" (UniqueName: \"kubernetes.io/projected/5930f51d-da11-4478-999e-c97def8f38ce-kube-api-access-zkkml\") pod \"kserve-controller-manager-d6f4b65b8-wpl64\" (UID: \"5930f51d-da11-4478-999e-c97def8f38ce\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:23.767126 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.767098 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:23.836198 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.836174 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:23.872774 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.872708 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:23.990744 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:23.990713 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wpl64"] Jul 13 23:44:23.993687 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:44:23.993653 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5930f51d_da11_4478_999e_c97def8f38ce.slice/crio-81a091a9f4fa418892161df1ccf968b3c0770d57c74cea6909f28ddd1d69d87e WatchSource:0}: Error finding container 81a091a9f4fa418892161df1ccf968b3c0770d57c74cea6909f28ddd1d69d87e: Status 404 returned error can't find the container with id 81a091a9f4fa418892161df1ccf968b3c0770d57c74cea6909f28ddd1d69d87e Jul 13 23:44:24.983830 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:24.983790 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" event={"ID":"5930f51d-da11-4478-999e-c97def8f38ce","Type":"ContainerStarted","Data":"81a091a9f4fa418892161df1ccf968b3c0770d57c74cea6909f28ddd1d69d87e"} Jul 13 23:44:26.995443 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:26.995411 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" event={"ID":"5930f51d-da11-4478-999e-c97def8f38ce","Type":"ContainerStarted","Data":"c6826a700fab9cc7fdd337daf62b04832508f3b4aaeb9c895d7faa13f45bafe2"} Jul 13 23:44:26.995846 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:26.995547 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:44:27.038256 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:27.038204 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" podStartSLOduration=1.632786489 podStartE2EDuration="4.038189035s" totalImagesPullingTime="2.405402546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:44:27.035898199 +0000 UTC m=+300.003594051" watchObservedRunningTime="2026-07-13 23:44:27.038189035 +0000 UTC m=+300.005884883" Jul 13 23:44:27.400715 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:27.400689 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:44:27.403422 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:27.403402 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:44:27.405560 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:27.405543 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 23:44:28.950469 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:28.950439 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-s54cz" Jul 13 23:44:33.979298 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:33.979270 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dc78dff7b-594xh" Jul 13 23:44:36.197998 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:36.197968 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:36.298361 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:36.298323 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:36.356449 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:36.356413 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:44:58.006728 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:44:58.006695 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wpl64" Jul 13 23:45:13.573531 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:13.573492 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:13.670999 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:13.670964 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:13.735337 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:13.735300 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:14.497417 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:14.497387 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:14.690946 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:14.690909 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:29.502330 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.502241 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c"] Jul 13 23:45:29.504907 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.504889 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.507565 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.507537 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gbt4b\"" Jul 13 23:45:29.507687 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.507582 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 23:45:29.507687 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.507599 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 23:45:29.517360 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.517337 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c"] Jul 13 23:45:29.614430 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.614384 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.614610 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.614451 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sznmd\" (UniqueName: \"kubernetes.io/projected/68ab4c62-a3aa-4de5-88db-5f0649e867e2-kube-api-access-sznmd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.614610 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.614483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.715286 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.715254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.715459 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.715306 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sznmd\" (UniqueName: \"kubernetes.io/projected/68ab4c62-a3aa-4de5-88db-5f0649e867e2-kube-api-access-sznmd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.715459 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.715331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.715660 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.715644 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.715715 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.715680 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.723202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.723181 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sznmd\" (UniqueName: \"kubernetes.io/projected/68ab4c62-a3aa-4de5-88db-5f0649e867e2-kube-api-access-sznmd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.816235 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.816208 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:29.946574 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:29.946423 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c"] Jul 13 23:45:29.949011 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:45:29.948983 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ab4c62_a3aa_4de5_88db_5f0649e867e2.slice/crio-361f462245c1d5024336ca84f26365c4ea770605d3ed1c02b9b09b23f4c2ab51 WatchSource:0}: Error finding container 361f462245c1d5024336ca84f26365c4ea770605d3ed1c02b9b09b23f4c2ab51: Status 404 returned error can't find the container with id 361f462245c1d5024336ca84f26365c4ea770605d3ed1c02b9b09b23f4c2ab51 Jul 13 23:45:30.304849 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.304761 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2"] Jul 13 23:45:30.307737 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.307719 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.317159 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.317131 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2"] Jul 13 23:45:30.321999 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.321973 2557 generic.go:356] "Generic (PLEG): container finished" podID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerID="98e417e359d2b944177a8891494db4bd3fba646983835f95db07c05d524e27b9" exitCode=0 Jul 13 23:45:30.322104 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.322007 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" event={"ID":"68ab4c62-a3aa-4de5-88db-5f0649e867e2","Type":"ContainerDied","Data":"98e417e359d2b944177a8891494db4bd3fba646983835f95db07c05d524e27b9"} Jul 13 23:45:30.322104 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.322038 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" event={"ID":"68ab4c62-a3aa-4de5-88db-5f0649e867e2","Type":"ContainerStarted","Data":"361f462245c1d5024336ca84f26365c4ea770605d3ed1c02b9b09b23f4c2ab51"} Jul 13 23:45:30.322450 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.322436 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 23:45:30.421073 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.421032 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqhs9\" (UniqueName: \"kubernetes.io/projected/a5576925-41c9-46f6-964c-4f51369bf159-kube-api-access-mqhs9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.421248 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.421116 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.421298 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.421237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.521896 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.521864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.522339 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.521914 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.522339 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.522034 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqhs9\" (UniqueName: \"kubernetes.io/projected/a5576925-41c9-46f6-964c-4f51369bf159-kube-api-access-mqhs9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.522446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.522336 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.522446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.522343 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.531035 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.531013 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqhs9\" (UniqueName: \"kubernetes.io/projected/a5576925-41c9-46f6-964c-4f51369bf159-kube-api-access-mqhs9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.616969 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.616939 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:30.702429 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.702402 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l"] Jul 13 23:45:30.705574 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.705554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.715019 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.714883 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l"] Jul 13 23:45:30.753488 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.753463 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2"] Jul 13 23:45:30.755591 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:45:30.755565 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5576925_41c9_46f6_964c_4f51369bf159.slice/crio-ba4dd5a2fa9581eaef2a1c26c590aa2ff4694b29ad9359e40cee9a7028724d36 WatchSource:0}: Error finding container ba4dd5a2fa9581eaef2a1c26c590aa2ff4694b29ad9359e40cee9a7028724d36: Status 404 returned error can't find the container with id ba4dd5a2fa9581eaef2a1c26c590aa2ff4694b29ad9359e40cee9a7028724d36 Jul 13 23:45:30.824793 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.824767 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9752p\" (UniqueName: \"kubernetes.io/projected/4f2b198c-eb31-4f17-bd26-b4e557d633d0-kube-api-access-9752p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.824917 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.824813 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.824977 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.824916 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.926279 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.926186 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.926279 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.926273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9752p\" (UniqueName: \"kubernetes.io/projected/4f2b198c-eb31-4f17-bd26-b4e557d633d0-kube-api-access-9752p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.926428 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.926311 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.926571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.926551 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.926610 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.926579 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:30.934399 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:30.934374 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9752p\" (UniqueName: \"kubernetes.io/projected/4f2b198c-eb31-4f17-bd26-b4e557d633d0-kube-api-access-9752p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:31.017365 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.017332 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:31.106050 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.106021 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf"] Jul 13 23:45:31.109277 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.109256 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.118877 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.118802 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf"] Jul 13 23:45:31.229934 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.229902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hrvz\" (UniqueName: \"kubernetes.io/projected/0ca7edc4-7f80-40f6-968d-0b0a0882a405-kube-api-access-9hrvz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.230115 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.230031 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.230190 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.230135 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.246549 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.246517 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l"] Jul 13 23:45:31.289610 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:45:31.289585 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2b198c_eb31_4f17_bd26_b4e557d633d0.slice/crio-cba9878ab91e138b34acc8fc7c0c8f062da40cf2d41a07adb5f18ed96e70c7f0 WatchSource:0}: Error finding container cba9878ab91e138b34acc8fc7c0c8f062da40cf2d41a07adb5f18ed96e70c7f0: Status 404 returned error can't find the container with id cba9878ab91e138b34acc8fc7c0c8f062da40cf2d41a07adb5f18ed96e70c7f0 Jul 13 23:45:31.329859 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.329815 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" event={"ID":"4f2b198c-eb31-4f17-bd26-b4e557d633d0","Type":"ContainerStarted","Data":"cba9878ab91e138b34acc8fc7c0c8f062da40cf2d41a07adb5f18ed96e70c7f0"} Jul 13 23:45:31.330548 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.330524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hrvz\" (UniqueName: \"kubernetes.io/projected/0ca7edc4-7f80-40f6-968d-0b0a0882a405-kube-api-access-9hrvz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.330661 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.330611 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.330731 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.330669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.331064 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.331040 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.331140 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.331068 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.331362 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.331343 2557 generic.go:356] "Generic (PLEG): container finished" podID="a5576925-41c9-46f6-964c-4f51369bf159" containerID="81ce5e956a3dd4a0f3265a1b246afa2a634a7fd4ba08ca9b1c505e785b288c28" exitCode=0 Jul 13 23:45:31.331443 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.331422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" event={"ID":"a5576925-41c9-46f6-964c-4f51369bf159","Type":"ContainerDied","Data":"81ce5e956a3dd4a0f3265a1b246afa2a634a7fd4ba08ca9b1c505e785b288c28"} Jul 13 23:45:31.331515 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.331473 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" event={"ID":"a5576925-41c9-46f6-964c-4f51369bf159","Type":"ContainerStarted","Data":"ba4dd5a2fa9581eaef2a1c26c590aa2ff4694b29ad9359e40cee9a7028724d36"} Jul 13 23:45:31.333392 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.333366 2557 generic.go:356] "Generic (PLEG): container finished" podID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerID="c81fa3839f926ed76aa49d5e4ace13c97e6729d06d6443c9c543c73dc65d51b6" exitCode=0 Jul 13 23:45:31.333503 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.333403 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" event={"ID":"68ab4c62-a3aa-4de5-88db-5f0649e867e2","Type":"ContainerDied","Data":"c81fa3839f926ed76aa49d5e4ace13c97e6729d06d6443c9c543c73dc65d51b6"} Jul 13 23:45:31.342295 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.339646 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hrvz\" (UniqueName: \"kubernetes.io/projected/0ca7edc4-7f80-40f6-968d-0b0a0882a405-kube-api-access-9hrvz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.420354 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.420320 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:31.552106 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:31.552075 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf"] Jul 13 23:45:31.555075 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:45:31.555050 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca7edc4_7f80_40f6_968d_0b0a0882a405.slice/crio-921e77aa54d44336a72408ee93dca4b88134301e165e858c6b884ee6f57c7f80 WatchSource:0}: Error finding container 921e77aa54d44336a72408ee93dca4b88134301e165e858c6b884ee6f57c7f80: Status 404 returned error can't find the container with id 921e77aa54d44336a72408ee93dca4b88134301e165e858c6b884ee6f57c7f80 Jul 13 23:45:32.340939 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.340906 2557 generic.go:356] "Generic (PLEG): container finished" podID="a5576925-41c9-46f6-964c-4f51369bf159" containerID="bad74217a26458cad102451fdacbfc5b6709c98bbfb0f8072368b5b61fbe8e26" exitCode=0 Jul 13 23:45:32.341086 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.340990 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" event={"ID":"a5576925-41c9-46f6-964c-4f51369bf159","Type":"ContainerDied","Data":"bad74217a26458cad102451fdacbfc5b6709c98bbfb0f8072368b5b61fbe8e26"} Jul 13 23:45:32.343125 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.343103 2557 generic.go:356] "Generic (PLEG): container finished" podID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerID="35034eae72e76fedfa32ccb721cf86bf9fbfd1d432edf32756191fc1cbbea0a8" exitCode=0 Jul 13 23:45:32.343228 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.343184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" event={"ID":"68ab4c62-a3aa-4de5-88db-5f0649e867e2","Type":"ContainerDied","Data":"35034eae72e76fedfa32ccb721cf86bf9fbfd1d432edf32756191fc1cbbea0a8"} Jul 13 23:45:32.344361 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.344344 2557 generic.go:356] "Generic (PLEG): container finished" podID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerID="d085d5978b52cec8f876a2a6842bb0838e4ae21bf3f14d1a45ffd6540a6c9947" exitCode=0 Jul 13 23:45:32.344446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.344409 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" event={"ID":"0ca7edc4-7f80-40f6-968d-0b0a0882a405","Type":"ContainerDied","Data":"d085d5978b52cec8f876a2a6842bb0838e4ae21bf3f14d1a45ffd6540a6c9947"} Jul 13 23:45:32.344446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.344434 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" event={"ID":"0ca7edc4-7f80-40f6-968d-0b0a0882a405","Type":"ContainerStarted","Data":"921e77aa54d44336a72408ee93dca4b88134301e165e858c6b884ee6f57c7f80"} Jul 13 23:45:32.346123 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.346102 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerID="c69a19a9565ebc814fb2ca571147753cfe77f16ce5bbf6fd4922a9b538340629" exitCode=0 Jul 13 23:45:32.346200 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:32.346160 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" event={"ID":"4f2b198c-eb31-4f17-bd26-b4e557d633d0","Type":"ContainerDied","Data":"c69a19a9565ebc814fb2ca571147753cfe77f16ce5bbf6fd4922a9b538340629"} Jul 13 23:45:33.360098 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.360056 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerID="c24c75bf1efb1972b915ee80811900f06b1b73e0d1a1b14d88e506bab3e17f85" exitCode=0 Jul 13 23:45:33.360550 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.360140 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" event={"ID":"4f2b198c-eb31-4f17-bd26-b4e557d633d0","Type":"ContainerDied","Data":"c24c75bf1efb1972b915ee80811900f06b1b73e0d1a1b14d88e506bab3e17f85"} Jul 13 23:45:33.363062 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.363040 2557 generic.go:356] "Generic (PLEG): container finished" podID="a5576925-41c9-46f6-964c-4f51369bf159" containerID="a40cf67bd6a0081e465732d552e9eb8818d84a3901e29652432445241bd6dce8" exitCode=0 Jul 13 23:45:33.363161 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.363138 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" event={"ID":"a5576925-41c9-46f6-964c-4f51369bf159","Type":"ContainerDied","Data":"a40cf67bd6a0081e465732d552e9eb8818d84a3901e29652432445241bd6dce8"} Jul 13 23:45:33.365080 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.365054 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" event={"ID":"0ca7edc4-7f80-40f6-968d-0b0a0882a405","Type":"ContainerStarted","Data":"29a3c5e8962803436823915ab07bb09e3fb667f112ced62a6d359925c66c57c0"} Jul 13 23:45:33.490656 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.490633 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:33.650653 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.650627 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-bundle\") pod \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " Jul 13 23:45:33.650653 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.650658 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sznmd\" (UniqueName: \"kubernetes.io/projected/68ab4c62-a3aa-4de5-88db-5f0649e867e2-kube-api-access-sznmd\") pod \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " Jul 13 23:45:33.650877 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.650723 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-util\") pod \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\" (UID: \"68ab4c62-a3aa-4de5-88db-5f0649e867e2\") " Jul 13 23:45:33.651467 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.651430 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-bundle" (OuterVolumeSpecName: "bundle") pod "68ab4c62-a3aa-4de5-88db-5f0649e867e2" (UID: "68ab4c62-a3aa-4de5-88db-5f0649e867e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:45:33.653090 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.653069 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68ab4c62-a3aa-4de5-88db-5f0649e867e2-kube-api-access-sznmd" (OuterVolumeSpecName: "kube-api-access-sznmd") pod "68ab4c62-a3aa-4de5-88db-5f0649e867e2" (UID: "68ab4c62-a3aa-4de5-88db-5f0649e867e2"). InnerVolumeSpecName "kube-api-access-sznmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:45:33.656132 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.656111 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-util" (OuterVolumeSpecName: "util") pod "68ab4c62-a3aa-4de5-88db-5f0649e867e2" (UID: "68ab4c62-a3aa-4de5-88db-5f0649e867e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:45:33.752249 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.752216 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:33.752249 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.752246 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sznmd\" (UniqueName: \"kubernetes.io/projected/68ab4c62-a3aa-4de5-88db-5f0649e867e2-kube-api-access-sznmd\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:33.752249 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:33.752257 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68ab4c62-a3aa-4de5-88db-5f0649e867e2-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:34.371616 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.371524 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" Jul 13 23:45:34.371616 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.371526 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c" event={"ID":"68ab4c62-a3aa-4de5-88db-5f0649e867e2","Type":"ContainerDied","Data":"361f462245c1d5024336ca84f26365c4ea770605d3ed1c02b9b09b23f4c2ab51"} Jul 13 23:45:34.372066 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.371642 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="361f462245c1d5024336ca84f26365c4ea770605d3ed1c02b9b09b23f4c2ab51" Jul 13 23:45:34.373324 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.373295 2557 generic.go:356] "Generic (PLEG): container finished" podID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerID="29a3c5e8962803436823915ab07bb09e3fb667f112ced62a6d359925c66c57c0" exitCode=0 Jul 13 23:45:34.373446 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.373325 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" event={"ID":"0ca7edc4-7f80-40f6-968d-0b0a0882a405","Type":"ContainerDied","Data":"29a3c5e8962803436823915ab07bb09e3fb667f112ced62a6d359925c66c57c0"} Jul 13 23:45:34.375626 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.375606 2557 generic.go:356] "Generic (PLEG): container finished" podID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerID="3289e639b24c13df9bb7e1b480a56bb0941493752a3eee83b9b1d477d4a0a2fd" exitCode=0 Jul 13 23:45:34.375740 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.375719 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" event={"ID":"4f2b198c-eb31-4f17-bd26-b4e557d633d0","Type":"ContainerDied","Data":"3289e639b24c13df9bb7e1b480a56bb0941493752a3eee83b9b1d477d4a0a2fd"} Jul 13 23:45:34.587984 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.587956 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:34.759379 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.759279 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-bundle\") pod \"a5576925-41c9-46f6-964c-4f51369bf159\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " Jul 13 23:45:34.759379 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.759358 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqhs9\" (UniqueName: \"kubernetes.io/projected/a5576925-41c9-46f6-964c-4f51369bf159-kube-api-access-mqhs9\") pod \"a5576925-41c9-46f6-964c-4f51369bf159\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " Jul 13 23:45:34.759602 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.759433 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-util\") pod \"a5576925-41c9-46f6-964c-4f51369bf159\" (UID: \"a5576925-41c9-46f6-964c-4f51369bf159\") " Jul 13 23:45:34.759813 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.759786 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-bundle" (OuterVolumeSpecName: "bundle") pod "a5576925-41c9-46f6-964c-4f51369bf159" (UID: "a5576925-41c9-46f6-964c-4f51369bf159"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:45:34.761462 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.761427 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5576925-41c9-46f6-964c-4f51369bf159-kube-api-access-mqhs9" (OuterVolumeSpecName: "kube-api-access-mqhs9") pod "a5576925-41c9-46f6-964c-4f51369bf159" (UID: "a5576925-41c9-46f6-964c-4f51369bf159"). InnerVolumeSpecName "kube-api-access-mqhs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:45:34.764699 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.764678 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-util" (OuterVolumeSpecName: "util") pod "a5576925-41c9-46f6-964c-4f51369bf159" (UID: "a5576925-41c9-46f6-964c-4f51369bf159"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:45:34.860490 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.860455 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:34.860490 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.860486 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5576925-41c9-46f6-964c-4f51369bf159-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:34.860490 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:34.860495 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqhs9\" (UniqueName: \"kubernetes.io/projected/a5576925-41c9-46f6-964c-4f51369bf159-kube-api-access-mqhs9\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:35.382590 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.382553 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" Jul 13 23:45:35.382994 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.382560 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2" event={"ID":"a5576925-41c9-46f6-964c-4f51369bf159","Type":"ContainerDied","Data":"ba4dd5a2fa9581eaef2a1c26c590aa2ff4694b29ad9359e40cee9a7028724d36"} Jul 13 23:45:35.382994 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.382689 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba4dd5a2fa9581eaef2a1c26c590aa2ff4694b29ad9359e40cee9a7028724d36" Jul 13 23:45:35.384728 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.384702 2557 generic.go:356] "Generic (PLEG): container finished" podID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerID="166f1ccc7ecc9bc4db77e43a988fcf9da9ddd64516665d356618bc43bf10fdbf" exitCode=0 Jul 13 23:45:35.384901 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.384774 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" event={"ID":"0ca7edc4-7f80-40f6-968d-0b0a0882a405","Type":"ContainerDied","Data":"166f1ccc7ecc9bc4db77e43a988fcf9da9ddd64516665d356618bc43bf10fdbf"} Jul 13 23:45:35.519548 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.519521 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:35.667491 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.667391 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-util\") pod \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " Jul 13 23:45:35.667491 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.667493 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-bundle\") pod \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " Jul 13 23:45:35.667690 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.667581 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9752p\" (UniqueName: \"kubernetes.io/projected/4f2b198c-eb31-4f17-bd26-b4e557d633d0-kube-api-access-9752p\") pod \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\" (UID: \"4f2b198c-eb31-4f17-bd26-b4e557d633d0\") " Jul 13 23:45:35.668152 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.668120 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-bundle" (OuterVolumeSpecName: "bundle") pod "4f2b198c-eb31-4f17-bd26-b4e557d633d0" (UID: "4f2b198c-eb31-4f17-bd26-b4e557d633d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:45:35.669638 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.669619 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2b198c-eb31-4f17-bd26-b4e557d633d0-kube-api-access-9752p" (OuterVolumeSpecName: "kube-api-access-9752p") pod "4f2b198c-eb31-4f17-bd26-b4e557d633d0" (UID: "4f2b198c-eb31-4f17-bd26-b4e557d633d0"). InnerVolumeSpecName "kube-api-access-9752p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:45:35.675332 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.675287 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-util" (OuterVolumeSpecName: "util") pod "4f2b198c-eb31-4f17-bd26-b4e557d633d0" (UID: "4f2b198c-eb31-4f17-bd26-b4e557d633d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:45:35.769017 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.768987 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9752p\" (UniqueName: \"kubernetes.io/projected/4f2b198c-eb31-4f17-bd26-b4e557d633d0-kube-api-access-9752p\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:35.769017 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.769013 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:35.769017 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:35.769023 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f2b198c-eb31-4f17-bd26-b4e557d633d0-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:36.391403 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.391373 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" Jul 13 23:45:36.391886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.391368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l" event={"ID":"4f2b198c-eb31-4f17-bd26-b4e557d633d0","Type":"ContainerDied","Data":"cba9878ab91e138b34acc8fc7c0c8f062da40cf2d41a07adb5f18ed96e70c7f0"} Jul 13 23:45:36.391886 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.391495 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cba9878ab91e138b34acc8fc7c0c8f062da40cf2d41a07adb5f18ed96e70c7f0" Jul 13 23:45:36.527511 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.527484 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:36.677982 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.677900 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-util\") pod \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " Jul 13 23:45:36.677982 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.677984 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-bundle\") pod \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " Jul 13 23:45:36.678148 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.678008 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hrvz\" (UniqueName: \"kubernetes.io/projected/0ca7edc4-7f80-40f6-968d-0b0a0882a405-kube-api-access-9hrvz\") pod \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\" (UID: \"0ca7edc4-7f80-40f6-968d-0b0a0882a405\") " Jul 13 23:45:36.678450 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.678413 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-bundle" (OuterVolumeSpecName: "bundle") pod "0ca7edc4-7f80-40f6-968d-0b0a0882a405" (UID: "0ca7edc4-7f80-40f6-968d-0b0a0882a405"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:45:36.680025 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.679999 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca7edc4-7f80-40f6-968d-0b0a0882a405-kube-api-access-9hrvz" (OuterVolumeSpecName: "kube-api-access-9hrvz") pod "0ca7edc4-7f80-40f6-968d-0b0a0882a405" (UID: "0ca7edc4-7f80-40f6-968d-0b0a0882a405"). InnerVolumeSpecName "kube-api-access-9hrvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:45:36.683625 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.683603 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-util" (OuterVolumeSpecName: "util") pod "0ca7edc4-7f80-40f6-968d-0b0a0882a405" (UID: "0ca7edc4-7f80-40f6-968d-0b0a0882a405"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 23:45:36.779643 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.779620 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hrvz\" (UniqueName: \"kubernetes.io/projected/0ca7edc4-7f80-40f6-968d-0b0a0882a405-kube-api-access-9hrvz\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:36.779643 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.779643 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-util\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:36.779792 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:36.779654 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ca7edc4-7f80-40f6-968d-0b0a0882a405-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:45:37.398638 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:37.398598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" event={"ID":"0ca7edc4-7f80-40f6-968d-0b0a0882a405","Type":"ContainerDied","Data":"921e77aa54d44336a72408ee93dca4b88134301e165e858c6b884ee6f57c7f80"} Jul 13 23:45:37.398638 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:37.398641 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf" Jul 13 23:45:37.399060 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:37.398659 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="921e77aa54d44336a72408ee93dca4b88134301e165e858c6b884ee6f57c7f80" Jul 13 23:45:43.019732 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:43.019697 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:46.581538 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:46.581502 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:46.683183 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:46.683149 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:47.780038 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.779999 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64f6bcccd5-4tzzp"] Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780344 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerName="pull" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780355 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerName="pull" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780365 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerName="util" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780371 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerName="util" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780377 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerName="extract" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780382 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerName="extract" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780389 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerName="extract" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780394 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerName="extract" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780400 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerName="util" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780405 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerName="util" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780418 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5576925-41c9-46f6-964c-4f51369bf159" containerName="util" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780423 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5576925-41c9-46f6-964c-4f51369bf159" containerName="util" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780428 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerName="pull" Jul 13 23:45:47.780426 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780433 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerName="pull" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780438 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerName="extract" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780443 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerName="extract" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780455 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerName="pull" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780459 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerName="pull" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780465 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5576925-41c9-46f6-964c-4f51369bf159" containerName="extract" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780469 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5576925-41c9-46f6-964c-4f51369bf159" containerName="extract" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780476 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5576925-41c9-46f6-964c-4f51369bf159" containerName="pull" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780480 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5576925-41c9-46f6-964c-4f51369bf159" containerName="pull" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780487 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerName="util" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780492 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerName="util" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780542 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5576925-41c9-46f6-964c-4f51369bf159" containerName="extract" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780548 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f2b198c-eb31-4f17-bd26-b4e557d633d0" containerName="extract" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780556 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ca7edc4-7f80-40f6-968d-0b0a0882a405" containerName="extract" Jul 13 23:45:47.780897 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.780566 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ab4c62-a3aa-4de5-88db-5f0649e867e2" containerName="extract" Jul 13 23:45:47.783937 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.783917 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.795358 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.795334 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f6bcccd5-4tzzp"] Jul 13 23:45:47.836929 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.836897 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:47.872144 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.872111 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-console-config\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.872280 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.872151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-oauth-serving-cert\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.872280 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.872179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/051106c5-102a-4402-8bec-6e3743685dcb-console-serving-cert\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.872280 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.872200 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-trusted-ca-bundle\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.872280 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.872250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-service-ca\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.872280 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.872274 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/051106c5-102a-4402-8bec-6e3743685dcb-console-oauth-config\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.872461 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.872288 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-684ss\" (UniqueName: \"kubernetes.io/projected/051106c5-102a-4402-8bec-6e3743685dcb-kube-api-access-684ss\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.939045 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.939011 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:47.973276 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.973242 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-service-ca\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.973442 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.973281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/051106c5-102a-4402-8bec-6e3743685dcb-console-oauth-config\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.973442 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.973299 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-684ss\" (UniqueName: \"kubernetes.io/projected/051106c5-102a-4402-8bec-6e3743685dcb-kube-api-access-684ss\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.973442 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.973342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-console-config\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.973442 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.973364 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-oauth-serving-cert\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.973442 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.973382 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/051106c5-102a-4402-8bec-6e3743685dcb-console-serving-cert\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.973442 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.973399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-trusted-ca-bundle\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.974105 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.974066 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-console-config\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.974174 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.974122 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-service-ca\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.974226 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.974176 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-oauth-serving-cert\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.974341 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.974316 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/051106c5-102a-4402-8bec-6e3743685dcb-trusted-ca-bundle\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.975849 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.975811 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/051106c5-102a-4402-8bec-6e3743685dcb-console-serving-cert\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.975999 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.975982 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/051106c5-102a-4402-8bec-6e3743685dcb-console-oauth-config\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:47.984378 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:47.984356 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-684ss\" (UniqueName: \"kubernetes.io/projected/051106c5-102a-4402-8bec-6e3743685dcb-kube-api-access-684ss\") pod \"console-64f6bcccd5-4tzzp\" (UID: \"051106c5-102a-4402-8bec-6e3743685dcb\") " pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:48.095049 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:48.095013 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:48.235411 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:48.235388 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f6bcccd5-4tzzp"] Jul 13 23:45:48.237125 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:45:48.237094 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051106c5_102a_4402_8bec_6e3743685dcb.slice/crio-16f7617c2a69a4db9114918d43b938920fe35cdf907e294c74d7ccdb76b9f415 WatchSource:0}: Error finding container 16f7617c2a69a4db9114918d43b938920fe35cdf907e294c74d7ccdb76b9f415: Status 404 returned error can't find the container with id 16f7617c2a69a4db9114918d43b938920fe35cdf907e294c74d7ccdb76b9f415 Jul 13 23:45:48.457328 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:48.457240 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f6bcccd5-4tzzp" event={"ID":"051106c5-102a-4402-8bec-6e3743685dcb","Type":"ContainerStarted","Data":"585de0717ff1796f221ba5b13d52d62d4e8d95891748a7afe4405620cc909181"} Jul 13 23:45:48.457328 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:48.457297 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f6bcccd5-4tzzp" event={"ID":"051106c5-102a-4402-8bec-6e3743685dcb","Type":"ContainerStarted","Data":"16f7617c2a69a4db9114918d43b938920fe35cdf907e294c74d7ccdb76b9f415"} Jul 13 23:45:48.476617 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:48.476571 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64f6bcccd5-4tzzp" podStartSLOduration=1.476557267 podStartE2EDuration="1.476557267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:45:48.474190072 +0000 UTC m=+381.441885921" watchObservedRunningTime="2026-07-13 23:45:48.476557267 +0000 UTC m=+381.444253117" Jul 13 23:45:48.519606 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:48.519566 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:48.623802 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:48.623761 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:51.225496 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:51.225456 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:51.618754 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:51.618698 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:53.101271 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:53.101230 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:54.632477 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:54.632444 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:55.478786 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:55.478739 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:57.472083 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:57.472046 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:58.095273 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.095236 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:58.095418 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.095329 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:58.099795 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.099771 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:58.517720 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.517638 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64f6bcccd5-4tzzp" Jul 13 23:45:58.566528 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.566496 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c967584b-d2k7g"] Jul 13 23:45:58.665009 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.664970 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:58.727246 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.727209 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:58.793327 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.793248 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:45:58.894494 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:45:58.894463 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:00.096963 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:00.096930 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:00.455712 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:00.455613 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:02.227118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:02.227080 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:02.290780 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:02.290747 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:05.038472 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:05.038441 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:05.102651 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:05.102619 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:10.891488 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:10.891454 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:10.984159 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:10.984114 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:11.190650 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:11.190558 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:13.307407 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:13.307374 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:13.407333 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:13.407297 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:17.615945 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:17.615903 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:17.717784 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:17.717760 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:20.026551 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:20.026518 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:20.130353 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:20.130317 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:23.593114 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.593073 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68c967584b-d2k7g" podUID="c217697a-cc34-479f-936f-e667969db53c" containerName="console" containerID="cri-o://efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f" gracePeriod=15 Jul 13 23:46:23.844671 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.844613 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:46:23.996473 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.996442 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-service-ca\") pod \"c217697a-cc34-479f-936f-e667969db53c\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " Jul 13 23:46:23.996642 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.996495 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-oauth-config\") pod \"c217697a-cc34-479f-936f-e667969db53c\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " Jul 13 23:46:23.996642 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.996517 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-console-config\") pod \"c217697a-cc34-479f-936f-e667969db53c\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " Jul 13 23:46:23.996642 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.996613 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-oauth-serving-cert\") pod \"c217697a-cc34-479f-936f-e667969db53c\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " Jul 13 23:46:23.996793 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.996706 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7qns\" (UniqueName: \"kubernetes.io/projected/c217697a-cc34-479f-936f-e667969db53c-kube-api-access-r7qns\") pod \"c217697a-cc34-479f-936f-e667969db53c\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " Jul 13 23:46:23.996793 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.996748 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-serving-cert\") pod \"c217697a-cc34-479f-936f-e667969db53c\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " Jul 13 23:46:23.996793 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.996778 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-trusted-ca-bundle\") pod \"c217697a-cc34-479f-936f-e667969db53c\" (UID: \"c217697a-cc34-479f-936f-e667969db53c\") " Jul 13 23:46:23.996989 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.996950 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-service-ca" (OuterVolumeSpecName: "service-ca") pod "c217697a-cc34-479f-936f-e667969db53c" (UID: "c217697a-cc34-479f-936f-e667969db53c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:46:23.997043 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.997005 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-console-config" (OuterVolumeSpecName: "console-config") pod "c217697a-cc34-479f-936f-e667969db53c" (UID: "c217697a-cc34-479f-936f-e667969db53c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:46:23.997158 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.997093 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c217697a-cc34-479f-936f-e667969db53c" (UID: "c217697a-cc34-479f-936f-e667969db53c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:46:23.997158 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.997138 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-service-ca\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:46:23.997304 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.997177 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-console-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:46:23.997342 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.997297 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c217697a-cc34-479f-936f-e667969db53c" (UID: "c217697a-cc34-479f-936f-e667969db53c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 23:46:23.998801 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.998778 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c217697a-cc34-479f-936f-e667969db53c" (UID: "c217697a-cc34-479f-936f-e667969db53c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:46:23.998947 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.998923 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c217697a-cc34-479f-936f-e667969db53c-kube-api-access-r7qns" (OuterVolumeSpecName: "kube-api-access-r7qns") pod "c217697a-cc34-479f-936f-e667969db53c" (UID: "c217697a-cc34-479f-936f-e667969db53c"). InnerVolumeSpecName "kube-api-access-r7qns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:46:23.999036 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:23.999018 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c217697a-cc34-479f-936f-e667969db53c" (UID: "c217697a-cc34-479f-936f-e667969db53c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 23:46:24.098355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.098276 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7qns\" (UniqueName: \"kubernetes.io/projected/c217697a-cc34-479f-936f-e667969db53c-kube-api-access-r7qns\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:46:24.098355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.098302 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:46:24.098355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.098311 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-trusted-ca-bundle\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:46:24.098355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.098320 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c217697a-cc34-479f-936f-e667969db53c-console-oauth-config\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:46:24.098355 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.098330 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c217697a-cc34-479f-936f-e667969db53c-oauth-serving-cert\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:46:24.654118 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.654081 2557 generic.go:356] "Generic (PLEG): container finished" podID="c217697a-cc34-479f-936f-e667969db53c" containerID="efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f" exitCode=0 Jul 13 23:46:24.654584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.654143 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c967584b-d2k7g" Jul 13 23:46:24.654584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.654157 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c967584b-d2k7g" event={"ID":"c217697a-cc34-479f-936f-e667969db53c","Type":"ContainerDied","Data":"efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f"} Jul 13 23:46:24.654584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.654199 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c967584b-d2k7g" event={"ID":"c217697a-cc34-479f-936f-e667969db53c","Type":"ContainerDied","Data":"16ec22a3e22da75cb33a70c9498ede9827b3fcbcce5543f368b595fd2091e4fa"} Jul 13 23:46:24.654584 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.654221 2557 scope.go:117] "RemoveContainer" containerID="efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f" Jul 13 23:46:24.663582 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.663564 2557 scope.go:117] "RemoveContainer" containerID="efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f" Jul 13 23:46:24.663870 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:46:24.663842 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f\": container with ID starting with efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f not found: ID does not exist" containerID="efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f" Jul 13 23:46:24.663935 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.663881 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f"} err="failed to get container status \"efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f\": rpc error: code = NotFound desc = could not find container \"efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f\": container with ID starting with efa2bef205cb4a5150e15eb84edbf3b00321692a1df877caa69d940e1ea7696f not found: ID does not exist" Jul 13 23:46:24.687093 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.687069 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c967584b-d2k7g"] Jul 13 23:46:24.691865 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:24.691846 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68c967584b-d2k7g"] Jul 13 23:46:25.516043 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:25.516012 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c217697a-cc34-479f-936f-e667969db53c" path="/var/lib/kubelet/pods/c217697a-cc34-479f-936f-e667969db53c/volumes" Jul 13 23:46:26.670288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:26.670255 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:26.738048 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:26.738017 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:29.418244 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:29.418213 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:29.519659 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:29.519622 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:30.011439 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:30.011399 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:30.089009 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:30.088976 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:33.828564 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:33.828528 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:33.888350 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:33.888322 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:39.214466 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:39.214429 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:39.314183 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:39.314150 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:42.619377 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:42.619342 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:42.682129 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:42.682092 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:50.640789 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:50.640712 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:50.784782 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:50.784744 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:52.025802 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:52.025762 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:52.125508 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:52.125477 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:54.530109 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:54.530074 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:54.624039 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:54.624006 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:55.360979 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:55.360941 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:55.492444 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:55.492408 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:55.547434 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:55.547404 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:56.187998 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.187964 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jz2br"] Jul 13 23:46:56.188373 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.188353 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c217697a-cc34-479f-936f-e667969db53c" containerName="console" Jul 13 23:46:56.188512 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.188409 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c217697a-cc34-479f-936f-e667969db53c" containerName="console" Jul 13 23:46:56.188578 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.188557 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c217697a-cc34-479f-936f-e667969db53c" containerName="console" Jul 13 23:46:56.191671 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.191651 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jz2br" Jul 13 23:46:56.194026 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.194007 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 23:46:56.194924 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.194908 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmwlm\"" Jul 13 23:46:56.194976 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.194911 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 23:46:56.199630 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.199607 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jz2br"] Jul 13 23:46:56.224433 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.224406 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:56.285853 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.285805 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6rl\" (UniqueName: \"kubernetes.io/projected/a278d1f1-7bf8-406a-a5f7-f9db128f31ec-kube-api-access-kh6rl\") pod \"authorino-58cd955675-jz2br\" (UID: \"a278d1f1-7bf8-406a-a5f7-f9db128f31ec\") " pod="kuadrant-system/authorino-58cd955675-jz2br" Jul 13 23:46:56.297866 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.297808 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:46:56.386324 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.386298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6rl\" (UniqueName: \"kubernetes.io/projected/a278d1f1-7bf8-406a-a5f7-f9db128f31ec-kube-api-access-kh6rl\") pod \"authorino-58cd955675-jz2br\" (UID: \"a278d1f1-7bf8-406a-a5f7-f9db128f31ec\") " pod="kuadrant-system/authorino-58cd955675-jz2br" Jul 13 23:46:56.395401 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.395375 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6rl\" (UniqueName: \"kubernetes.io/projected/a278d1f1-7bf8-406a-a5f7-f9db128f31ec-kube-api-access-kh6rl\") pod \"authorino-58cd955675-jz2br\" (UID: \"a278d1f1-7bf8-406a-a5f7-f9db128f31ec\") " pod="kuadrant-system/authorino-58cd955675-jz2br" Jul 13 23:46:56.502058 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.501979 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jz2br" Jul 13 23:46:56.635598 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.635573 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jz2br"] Jul 13 23:46:56.637296 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:46:56.637271 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda278d1f1_7bf8_406a_a5f7_f9db128f31ec.slice/crio-a63af2f592b3de9c681b92fb98937a552f453a8eb6b2489528712057ebe3ce6c WatchSource:0}: Error finding container a63af2f592b3de9c681b92fb98937a552f453a8eb6b2489528712057ebe3ce6c: Status 404 returned error can't find the container with id a63af2f592b3de9c681b92fb98937a552f453a8eb6b2489528712057ebe3ce6c Jul 13 23:46:56.818093 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:46:56.818057 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jz2br" event={"ID":"a278d1f1-7bf8-406a-a5f7-f9db128f31ec","Type":"ContainerStarted","Data":"a63af2f592b3de9c681b92fb98937a552f453a8eb6b2489528712057ebe3ce6c"} Jul 13 23:47:00.844255 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:00.844218 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jz2br" event={"ID":"a278d1f1-7bf8-406a-a5f7-f9db128f31ec","Type":"ContainerStarted","Data":"de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc"} Jul 13 23:47:00.860002 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:00.859955 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jz2br" podStartSLOduration=1.311694502 podStartE2EDuration="4.85994042s" totalImagesPullingTime="3.548245918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:47:00.859030954 +0000 UTC m=+453.826726803" watchObservedRunningTime="2026-07-13 23:47:00.85994042 +0000 UTC m=+453.827636269" Jul 13 23:47:00.970961 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:00.970925 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jz2br"] Jul 13 23:47:02.856202 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:02.856136 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jz2br" podUID="a278d1f1-7bf8-406a-a5f7-f9db128f31ec" containerName="authorino" containerID="cri-o://de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc" gracePeriod=30 Jul 13 23:47:03.101802 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.101779 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jz2br" Jul 13 23:47:03.251812 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.251728 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh6rl\" (UniqueName: \"kubernetes.io/projected/a278d1f1-7bf8-406a-a5f7-f9db128f31ec-kube-api-access-kh6rl\") pod \"a278d1f1-7bf8-406a-a5f7-f9db128f31ec\" (UID: \"a278d1f1-7bf8-406a-a5f7-f9db128f31ec\") " Jul 13 23:47:03.253772 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.253743 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a278d1f1-7bf8-406a-a5f7-f9db128f31ec-kube-api-access-kh6rl" (OuterVolumeSpecName: "kube-api-access-kh6rl") pod "a278d1f1-7bf8-406a-a5f7-f9db128f31ec" (UID: "a278d1f1-7bf8-406a-a5f7-f9db128f31ec"). InnerVolumeSpecName "kube-api-access-kh6rl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 23:47:03.353218 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.353186 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh6rl\" (UniqueName: \"kubernetes.io/projected/a278d1f1-7bf8-406a-a5f7-f9db128f31ec-kube-api-access-kh6rl\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 13 23:47:03.862597 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.862564 2557 generic.go:356] "Generic (PLEG): container finished" podID="a278d1f1-7bf8-406a-a5f7-f9db128f31ec" containerID="de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc" exitCode=0 Jul 13 23:47:03.863023 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.862620 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jz2br" Jul 13 23:47:03.863023 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.862620 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jz2br" event={"ID":"a278d1f1-7bf8-406a-a5f7-f9db128f31ec","Type":"ContainerDied","Data":"de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc"} Jul 13 23:47:03.863023 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.862738 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jz2br" event={"ID":"a278d1f1-7bf8-406a-a5f7-f9db128f31ec","Type":"ContainerDied","Data":"a63af2f592b3de9c681b92fb98937a552f453a8eb6b2489528712057ebe3ce6c"} Jul 13 23:47:03.863023 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.862757 2557 scope.go:117] "RemoveContainer" containerID="de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc" Jul 13 23:47:03.873636 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.873598 2557 scope.go:117] "RemoveContainer" containerID="de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc" Jul 13 23:47:03.874057 ip-10-0-136-62 kubenswrapper[2557]: E0713 23:47:03.874033 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc\": container with ID starting with de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc not found: ID does not exist" containerID="de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc" Jul 13 23:47:03.874127 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.874067 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc"} err="failed to get container status \"de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc\": rpc error: code = NotFound desc = could not find container \"de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc\": container with ID starting with de218b88e863a838f125d84b071e7b433ce367683583457bea10faf7088e5ecc not found: ID does not exist" Jul 13 23:47:03.878792 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.878769 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jz2br"] Jul 13 23:47:03.882719 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:03.882695 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jz2br"] Jul 13 23:47:05.516733 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:05.516697 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a278d1f1-7bf8-406a-a5f7-f9db128f31ec" path="/var/lib/kubelet/pods/a278d1f1-7bf8-406a-a5f7-f9db128f31ec/volumes" Jul 13 23:47:16.542546 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:16.542513 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:16.641957 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:16.641923 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:17.015045 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:17.015005 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:28.813249 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:28.813211 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:29.132875 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:29.132763 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:35.771967 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:35.771909 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:35.871910 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:35.871878 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:35.973974 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:35.973927 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:36.033354 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:36.033276 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:39.282101 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:39.282063 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:47:39.382868 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:47:39.382834 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:10.996670 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:10.996625 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:11.096167 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:11.096134 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:11.485038 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:11.485008 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:11.569571 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:11.569537 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:12.095499 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:12.095468 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:12.193053 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:12.193022 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:15.840289 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:15.840254 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:22.677632 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:22.677549 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:22.779978 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:22.779945 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:26.370379 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:26.370347 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:33.148864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.148812 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8"] Jul 13 23:48:33.149979 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.149950 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a278d1f1-7bf8-406a-a5f7-f9db128f31ec" containerName="authorino" Jul 13 23:48:33.150145 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.150135 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a278d1f1-7bf8-406a-a5f7-f9db128f31ec" containerName="authorino" Jul 13 23:48:33.150333 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.150323 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a278d1f1-7bf8-406a-a5f7-f9db128f31ec" containerName="authorino" Jul 13 23:48:33.152797 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.152778 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.157537 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.157517 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 23:48:33.157966 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.157761 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 23:48:33.160888 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.160866 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fjg7x\"" Jul 13 23:48:33.161494 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.161475 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 13 23:48:33.163454 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.163433 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8"] Jul 13 23:48:33.183494 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.183469 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:48:33.232627 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.232592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.232741 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.232632 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.232741 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.232654 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94af05a0-a2d2-46a8-9953-1722d38a0803-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.232741 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.232727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.232917 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.232808 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qflhr\" (UniqueName: \"kubernetes.io/projected/94af05a0-a2d2-46a8-9953-1722d38a0803-kube-api-access-qflhr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.232917 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.232861 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333336 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333295 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qflhr\" (UniqueName: \"kubernetes.io/projected/94af05a0-a2d2-46a8-9953-1722d38a0803-kube-api-access-qflhr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333336 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333601 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333601 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333397 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333601 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94af05a0-a2d2-46a8-9953-1722d38a0803-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333601 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333858 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333810 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333928 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333888 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.333928 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.333915 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.335768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.335749 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94af05a0-a2d2-46a8-9953-1722d38a0803-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.336018 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.336001 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94af05a0-a2d2-46a8-9953-1722d38a0803-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.341524 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.341501 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qflhr\" (UniqueName: \"kubernetes.io/projected/94af05a0-a2d2-46a8-9953-1722d38a0803-kube-api-access-qflhr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5rgd8\" (UID: \"94af05a0-a2d2-46a8-9953-1722d38a0803\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.471079 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.470986 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:33.605814 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:33.605785 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8"] Jul 13 23:48:33.607892 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:48:33.607864 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94af05a0_a2d2_46a8_9953_1722d38a0803.slice/crio-d803541248f1c8fae6c7995492ed782775ed7bb533ab4b1745915f5a6e719ce4 WatchSource:0}: Error finding container d803541248f1c8fae6c7995492ed782775ed7bb533ab4b1745915f5a6e719ce4: Status 404 returned error can't find the container with id d803541248f1c8fae6c7995492ed782775ed7bb533ab4b1745915f5a6e719ce4 Jul 13 23:48:34.344718 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:34.344683 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" event={"ID":"94af05a0-a2d2-46a8-9953-1722d38a0803","Type":"ContainerStarted","Data":"d803541248f1c8fae6c7995492ed782775ed7bb533ab4b1745915f5a6e719ce4"} Jul 13 23:48:35.351316 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:35.351270 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" event={"ID":"94af05a0-a2d2-46a8-9953-1722d38a0803","Type":"ContainerStarted","Data":"1b551b1060ca75dc6063280619c9e832fe3a908d248ab43a9b64035d6f8f3d1f"} Jul 13 23:48:35.371226 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:35.371180 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" podStartSLOduration=1.409212806 podStartE2EDuration="2.371163872s" totalImagesPullingTime="961.951066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:48:35.369020483 +0000 UTC m=+548.336716345" watchObservedRunningTime="2026-07-13 23:48:35.371163872 +0000 UTC m=+548.338859721" Jul 13 23:48:43.471166 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:43.471128 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:43.471628 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:43.471202 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:43.483066 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:43.483032 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:44.415301 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:44.415262 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5rgd8" Jul 13 23:48:47.776595 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:48:47.776561 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:49:02.850920 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.850884 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt"] Jul 13 23:49:02.853288 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.853271 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.856046 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.856021 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 13 23:49:02.865794 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.865772 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt"] Jul 13 23:49:02.881945 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.881922 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:49:02.893495 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.893468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.893581 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.893519 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.893581 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.893536 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qfh\" (UniqueName: \"kubernetes.io/projected/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-kube-api-access-k6qfh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.893659 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.893582 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.893659 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.893625 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.893659 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.893652 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.994450 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.994428 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.994556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.994464 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.994556 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.994486 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.994692 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.994661 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.994843 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.994765 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.994843 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.994771 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.994843 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.994795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qfh\" (UniqueName: \"kubernetes.io/projected/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-kube-api-access-k6qfh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.994990 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.994860 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.995033 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.995018 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.996788 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.996770 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:02.996959 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:02.996943 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:03.003640 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:03.003614 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qfh\" (UniqueName: \"kubernetes.io/projected/7afcfcfd-2c7e-4d22-a10a-573952d33dcf-kube-api-access-k6qfh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt\" (UID: \"7afcfcfd-2c7e-4d22-a10a-573952d33dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:03.165671 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:03.165583 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:03.294563 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:03.294539 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt"] Jul 13 23:49:03.296252 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:49:03.296225 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afcfcfd_2c7e_4d22_a10a_573952d33dcf.slice/crio-b67b27b87638731073fdd20d2720fb78656cfa5d151f598526d6d5e4fd1ca00b WatchSource:0}: Error finding container b67b27b87638731073fdd20d2720fb78656cfa5d151f598526d6d5e4fd1ca00b: Status 404 returned error can't find the container with id b67b27b87638731073fdd20d2720fb78656cfa5d151f598526d6d5e4fd1ca00b Jul 13 23:49:03.497214 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:03.497135 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" event={"ID":"7afcfcfd-2c7e-4d22-a10a-573952d33dcf","Type":"ContainerStarted","Data":"b67b27b87638731073fdd20d2720fb78656cfa5d151f598526d6d5e4fd1ca00b"} Jul 13 23:49:04.504387 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:04.504353 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" event={"ID":"7afcfcfd-2c7e-4d22-a10a-573952d33dcf","Type":"ContainerStarted","Data":"1c42bee91b361874042fd0aa4f4adc63b1bfb23b06aba5970d9fa174cd47ca7a"} Jul 13 23:49:04.524691 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:04.524639 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" podStartSLOduration=2.31439139 podStartE2EDuration="2.524623878s" totalImagesPullingTime="210.232488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:49:04.522174196 +0000 UTC m=+577.489870046" watchObservedRunningTime="2026-07-13 23:49:04.524623878 +0000 UTC m=+577.492319728" Jul 13 23:49:04.941445 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:04.941414 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp"] Jul 13 23:49:04.948295 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:04.948274 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:04.950917 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:04.950899 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 13 23:49:04.955063 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:04.955039 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp"] Jul 13 23:49:04.972280 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:04.972255 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:49:05.012559 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.012535 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.012669 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.012581 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdk92\" (UniqueName: \"kubernetes.io/projected/480253af-299d-48c3-8699-515f03b9949c-kube-api-access-sdk92\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.012735 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.012688 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.012735 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.012726 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.012878 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.012775 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.012878 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.012806 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/480253af-299d-48c3-8699-515f03b9949c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113299 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113268 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113457 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdk92\" (UniqueName: \"kubernetes.io/projected/480253af-299d-48c3-8699-515f03b9949c-kube-api-access-sdk92\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113457 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113352 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113457 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113370 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113457 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113391 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113457 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113406 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/480253af-299d-48c3-8699-515f03b9949c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113792 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113769 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113879 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113794 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.113926 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.113877 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.115622 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.115598 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/480253af-299d-48c3-8699-515f03b9949c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.115779 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.115764 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/480253af-299d-48c3-8699-515f03b9949c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.121834 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.121803 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdk92\" (UniqueName: \"kubernetes.io/projected/480253af-299d-48c3-8699-515f03b9949c-kube-api-access-sdk92\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6s9kp\" (UID: \"480253af-299d-48c3-8699-515f03b9949c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.261255 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.261174 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:05.392805 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.392777 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp"] Jul 13 23:49:05.395226 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:49:05.395202 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480253af_299d_48c3_8699_515f03b9949c.slice/crio-387a39fec27ef9d62bc97b2cf1801592803828fad6dc1905026710be04182508 WatchSource:0}: Error finding container 387a39fec27ef9d62bc97b2cf1801592803828fad6dc1905026710be04182508: Status 404 returned error can't find the container with id 387a39fec27ef9d62bc97b2cf1801592803828fad6dc1905026710be04182508 Jul 13 23:49:05.515201 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:05.515125 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" event={"ID":"480253af-299d-48c3-8699-515f03b9949c","Type":"ContainerStarted","Data":"387a39fec27ef9d62bc97b2cf1801592803828fad6dc1905026710be04182508"} Jul 13 23:49:06.516427 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:06.516397 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" event={"ID":"480253af-299d-48c3-8699-515f03b9949c","Type":"ContainerStarted","Data":"0d77f3d10abae98b6b463f4818985044a17e416c67eb96a359145643ff90775a"} Jul 13 23:49:06.535080 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:06.535031 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" podStartSLOduration=2.35791225 podStartE2EDuration="2.535014759s" totalImagesPullingTime="177.102509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:49:06.534653569 +0000 UTC m=+579.502349420" watchObservedRunningTime="2026-07-13 23:49:06.535014759 +0000 UTC m=+579.502710608" Jul 13 23:49:13.166074 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.166036 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:13.166524 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.166101 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:13.178558 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.178531 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:13.340474 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.340442 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb"] Jul 13 23:49:13.344310 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.344288 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.346647 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.346627 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 13 23:49:13.355171 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.355148 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb"] Jul 13 23:49:13.372435 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.372411 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:49:13.388267 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.388241 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.388352 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.388269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.388352 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.388285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.388422 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.388352 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdg8\" (UniqueName: \"kubernetes.io/projected/2112db6e-1a89-4061-be36-4b8d56d5ad9a-kube-api-access-jfdg8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.388422 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.388390 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2112db6e-1a89-4061-be36-4b8d56d5ad9a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.388488 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.388429 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.489495 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.489431 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.489495 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.489460 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.489495 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.489479 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.489751 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.489528 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdg8\" (UniqueName: \"kubernetes.io/projected/2112db6e-1a89-4061-be36-4b8d56d5ad9a-kube-api-access-jfdg8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.489751 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.489642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2112db6e-1a89-4061-be36-4b8d56d5ad9a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.489751 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.489703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.489971 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.489949 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.490030 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.489970 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.490030 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.490015 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.491972 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.491947 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2112db6e-1a89-4061-be36-4b8d56d5ad9a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.492076 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.492056 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2112db6e-1a89-4061-be36-4b8d56d5ad9a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.497934 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.497915 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdg8\" (UniqueName: \"kubernetes.io/projected/2112db6e-1a89-4061-be36-4b8d56d5ad9a-kube-api-access-jfdg8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb\" (UID: \"2112db6e-1a89-4061-be36-4b8d56d5ad9a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.566510 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.566483 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt" Jul 13 23:49:13.654864 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.654814 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:13.785913 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:13.785886 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb"] Jul 13 23:49:13.788423 ip-10-0-136-62 kubenswrapper[2557]: W0713 23:49:13.788394 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2112db6e_1a89_4061_be36_4b8d56d5ad9a.slice/crio-fcf36fd8e8bf7c2a26cbdb350ddf798220d530c12678b57286c9264704ac3143 WatchSource:0}: Error finding container fcf36fd8e8bf7c2a26cbdb350ddf798220d530c12678b57286c9264704ac3143: Status 404 returned error can't find the container with id fcf36fd8e8bf7c2a26cbdb350ddf798220d530c12678b57286c9264704ac3143 Jul 13 23:49:14.561841 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:14.561773 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" event={"ID":"2112db6e-1a89-4061-be36-4b8d56d5ad9a","Type":"ContainerStarted","Data":"3d1aa8842a1952f1f858416a80064ac198d20804c56d868b717a24167cfdb8ae"} Jul 13 23:49:14.561841 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:14.561840 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" event={"ID":"2112db6e-1a89-4061-be36-4b8d56d5ad9a","Type":"ContainerStarted","Data":"fcf36fd8e8bf7c2a26cbdb350ddf798220d530c12678b57286c9264704ac3143"} Jul 13 23:49:14.580946 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:14.580900 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" podStartSLOduration=1.396916452 podStartE2EDuration="1.58088487s" totalImagesPullingTime="183.968418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 23:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 23:49:14.579966236 +0000 UTC m=+587.547662085" watchObservedRunningTime="2026-07-13 23:49:14.58088487 +0000 UTC m=+587.548580737" Jul 13 23:49:15.261586 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:15.261556 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:15.261764 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:15.261645 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:15.274074 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:15.274051 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:15.578357 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:15.578331 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6s9kp" Jul 13 23:49:23.655445 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:23.655411 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:23.655894 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:23.655465 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:23.667717 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:23.667690 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:24.627771 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:24.627741 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb" Jul 13 23:49:27.444261 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:27.444186 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:49:27.444964 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:27.444938 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:49:49.610760 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:49.610681 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:49:59.603854 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:49:59.603799 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:50:00.579841 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:50:00.579784 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:50:22.536214 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:50:22.536173 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:50:22.632418 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:50:22.632384 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:50:23.700038 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:50:23.700003 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:50:23.824363 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:50:23.824328 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:50:46.820005 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:50:46.819968 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:51:21.016768 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:51:21.016693 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:51:34.579417 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:51:34.579382 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:51:36.246225 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:51:36.246191 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:51:48.599880 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:51:48.599845 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:16.924747 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:16.924712 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:17.023998 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:17.023963 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:17.193239 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:17.193136 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:22.696108 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:22.696076 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:22.764950 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:22.764910 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:22.843843 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:22.843794 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:22.949729 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:22.949653 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:23.112762 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:23.112723 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:28.604691 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:28.604656 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:52:28.662730 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:52:28.662698 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:54:27.481772 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:54:27.481675 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:54:27.484509 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:54:27.484488 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:54:44.191466 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:54:44.191425 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:56:33.252331 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:56:33.252301 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:56:33.307672 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:56:33.307633 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:57:53.867496 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:57:53.867453 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:57:53.924226 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:57:53.924195 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:59:20.668483 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:59:20.668447 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 13 23:59:27.524832 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:59:27.524792 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 13 23:59:27.527872 ip-10-0-136-62 kubenswrapper[2557]: I0713 23:59:27.527851 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:02:57.366740 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:02:57.366709 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:17.270361 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:17.270325 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:27.098433 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:27.098350 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:35.346393 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:35.346361 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:40.444936 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:40.444904 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:43.411883 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:43.411850 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:43.510973 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:43.510934 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:43.850554 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:43.850522 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:49.504607 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:49.504574 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:49.614255 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:49.614220 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:49.685701 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:49.685670 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:49.752680 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:49.752651 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:51.994919 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:51.994880 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:52.092238 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:52.092205 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:03:53.251999 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:03:53.251974 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:06.635604 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:06.635569 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:10.951476 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:10.951433 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:16.871039 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:16.871004 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:16.940836 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:16.940787 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:21.192552 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:21.192518 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:21.483226 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:21.483130 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:21.586737 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:21.586701 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:21.684169 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:21.684141 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:22.894405 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:22.894373 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:23.002436 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:23.002387 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:23.457124 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:23.457084 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:23.583012 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:23.582978 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:23.678367 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:23.678333 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:27.539193 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:27.539159 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:27.566845 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:27.566798 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:04:27.568608 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:27.568585 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:04:27.640220 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:27.640186 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:30.968081 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:30.968045 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:04:46.559797 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:04:46.559766 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:27.629906 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:27.629865 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:27.685395 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:27.685365 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:32.927028 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:32.926989 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:33.762279 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:33.762244 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:34.094843 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:34.094798 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:39.253737 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:39.253702 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:39.353971 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:39.353944 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:39.502508 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:39.502469 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:39.604148 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:39.604113 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:40.605775 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:40.605739 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:40.702894 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:40.702866 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:40.820624 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:40.820590 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:40.992690 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:40.992599 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:41.340511 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:41.340476 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:41.438075 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:41.438040 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:05:43.163265 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:05:43.163225 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:06:03.800467 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:06:03.800430 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:06:03.849026 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:06:03.848997 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:06:56.425730 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:06:56.425692 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:06:58.739559 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:06:58.739524 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:06:58.844494 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:06:58.844458 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:00.821312 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:00.821268 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:06.583666 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:06.583632 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:06.646497 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:06.646413 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:11.869495 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:11.869448 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:12.224575 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:12.224543 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:13.277105 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:13.277069 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:13.360965 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:13.360937 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:13.473479 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:13.473449 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:14.000802 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:14.000770 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:14.102228 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:14.102198 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:18.279590 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:18.279556 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:18.334869 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:18.334812 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:07:21.685656 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:07:21.685625 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:18.140864 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:18.140830 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:22.826952 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:22.826919 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:28.771356 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:28.771315 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:28.870969 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:28.870942 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:33.015588 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:33.015526 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:33.590193 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:33.590159 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:33.688883 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:33.688848 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:33.789577 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:33.789543 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:35.193835 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:35.193798 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:39.461446 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:39.461412 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:40.884008 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:40.883975 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:40.945525 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:40.945471 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:41.028464 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:41.028428 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:41.126669 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:41.126636 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:41.226655 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:41.226580 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:08:41.608902 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:08:41.608845 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:07.598796 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:07.598763 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:13.158119 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:13.158059 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:13.258932 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:13.258899 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:13.359517 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:13.359489 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:27.603152 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:27.603127 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:09:27.606903 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:27.606882 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:09:29.311371 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:29.311337 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:34.865960 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:34.865921 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:34.924330 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:34.924296 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:34.996514 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:34.996483 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:35.093907 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:35.093876 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:45.599141 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:45.599109 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:46.410247 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:46.410209 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:52.290160 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:52.290129 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:52.347273 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:52.347246 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:52.424116 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:52.424079 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:52.523272 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:52.523241 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:52.623237 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:52.623203 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:53.371844 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:53.371770 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:53.471216 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:53.471179 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:53.781694 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:53.781606 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:09:55.182679 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:09:55.182642 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:00.874666 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:00.874627 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:00.943116 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:00.943076 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:01.737629 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:01.737595 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:07.234265 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:07.234228 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:07.290285 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:07.290249 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:07.504672 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:07.504576 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:07.789845 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:07.789744 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:07.982333 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:07.982286 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:10.833352 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:10.833318 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:10.930749 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:10.930711 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:11.111672 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:11.111590 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:11.317649 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:11.317614 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:11.671206 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:11.671179 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:11.770664 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:11.770625 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:15.338131 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:15.338098 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:16.037218 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:16.037182 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:16.139609 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:16.139569 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:16.499332 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:16.499290 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:22.228976 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:22.228947 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:22.289073 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:22.289037 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:33.017671 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:33.017642 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:37.678955 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:37.678922 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:43.416527 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:43.416488 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:43.473924 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:43.473894 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:48.382875 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:48.382809 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:48.662580 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:48.662497 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:48.766979 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:48.766943 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:48.863314 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:48.863277 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:48.963990 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:48.963902 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:54.593069 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:54.593037 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:54.655515 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:54.655480 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:54.722127 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:54.722091 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:54.824197 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:54.824151 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:10:54.940714 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:10:54.940631 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:00.511006 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:00.510973 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:00.572467 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:00.572432 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:07.428112 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:07.428073 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:07.750139 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:07.750057 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:08.301836 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:08.301787 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:11.165049 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:11.165018 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:11.266028 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:11.265991 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:11.416482 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:11.416408 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:11.941603 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:11.941562 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:12.044714 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:12.044680 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:12.190899 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:12.190865 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:15.659695 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:15.659653 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:20.563997 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:20.563962 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:54.215681 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:54.215644 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:58.819805 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:58.819772 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:59.582598 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:59.582563 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:11:59.684014 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:11:59.683984 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:03.967219 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:03.967186 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:39.948519 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:39.948431 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:40.869620 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:40.869576 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:46.895321 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:46.895283 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:47.000458 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:47.000427 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:51.081396 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:51.081331 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:51.317382 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:51.317329 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:52.363339 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:52.363299 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:52.451705 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:52.451668 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:52.552286 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:52.552252 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:53.244650 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:53.244608 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:53.343801 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:53.343766 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:53.466685 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:53.466653 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:12:54.762189 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:12:54.762157 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:00.448860 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:00.448797 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:00.518754 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:00.518718 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:01.113379 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:01.113342 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:06.958008 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:06.957971 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:07.063989 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:07.063955 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:07.162698 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:07.162664 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:17.664477 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:17.664440 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:18.027631 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:18.027538 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:24.489838 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:24.489797 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:38.983722 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:38.983685 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:43.301631 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:43.301594 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:43.356143 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:43.356110 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:44.703650 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:44.703618 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:44.804430 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:44.804400 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:45.054388 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:45.054304 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:45.365449 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:45.365411 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:46.064145 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:46.064105 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:47.943867 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:47.941961 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:48.014876 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:48.014844 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:48.076701 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:48.076670 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:48.562210 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:48.562178 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:48.688468 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:48.688438 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:48.788373 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:48.788343 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:50.387610 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:50.387530 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:50.441299 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:50.441269 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:52.426607 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:52.426574 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:52.751268 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:52.751166 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:53.068461 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:53.068429 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:53.175537 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:53.175505 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:55.504706 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:55.504654 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:55.604202 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:55.604165 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:55.721520 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:55.721482 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:56.153701 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:56.153665 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:56.252978 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:56.252945 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:13:56.353942 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:13:56.353907 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:00.027686 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:00.027642 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:06.046958 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:06.046921 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:09.540844 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:09.540792 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:09.642658 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:09.642624 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:18.023976 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:18.023893 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:18.124304 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:18.124267 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:23.373047 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:23.373005 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:27.641731 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:27.641702 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:14:27.646043 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:27.646022 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:14:43.306883 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:43.306810 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:44.245888 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:44.245857 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:44.848066 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:44.848035 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:44.950179 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:44.950146 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:54.927069 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:54.927017 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:14:59.453085 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:14:59.453049 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:05.151774 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:05.151738 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:05.252613 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:05.252579 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:10.132073 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:10.132036 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:10.365243 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:10.365211 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:10.981355 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:10.981322 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:11.080471 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:11.080434 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:20.060733 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:20.060641 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:20.111484 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:20.111451 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:21.118684 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:21.118624 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:25.574924 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:25.574884 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:31.451941 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:31.451897 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:31.554112 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:31.554077 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:36.258655 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:36.258620 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:36.486629 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:36.486601 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:36.829747 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:36.829712 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:37.157617 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:37.157538 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:37.512274 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:37.512182 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:40.560191 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:40.560148 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:40.654372 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:40.654331 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:40.718916 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:40.718881 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:40.898849 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:40.898795 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:41.316454 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:41.316421 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:41.417227 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:41.417195 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:45.072318 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:45.072286 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:45.540195 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:45.540114 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:45.839089 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:45.839054 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:46.142928 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:46.142839 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:49.080877 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:49.080838 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:49.179646 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:49.179610 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:49.360498 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:49.360409 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:49.784756 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:49.784656 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:49.885286 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:49.885248 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:49.986477 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:49.986415 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:15:53.589456 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:15:53.589418 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:02.140990 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:02.140951 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:02.242572 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:02.242539 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:10.695633 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:10.695556 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:10.794288 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:10.794250 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:12.125795 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:12.125760 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:12.228766 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:12.228730 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:12.386276 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:12.386193 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:16.697310 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:16.697283 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:22.588391 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:22.588349 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:22.688016 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:22.687981 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:27.387251 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:27.387214 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:27.598873 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:27.598844 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:28.427008 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:28.426971 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:28.527993 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:28.527957 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:38.160669 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:38.160624 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:42.811234 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:42.811200 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:48.526097 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:48.526062 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:48.594717 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:48.594678 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:53.496238 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:53.496165 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:53.733647 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:53.733600 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:54.072946 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:54.072915 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:54.906594 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:54.906559 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:54.963981 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:54.963939 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:56.932029 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:56.931992 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:57.528642 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:57.528614 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:57.639871 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:57.639835 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:57.913653 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:57.913601 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:16:58.014563 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:16:58.014529 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:00.404426 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:00.404392 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:00.505060 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:00.505028 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:01.475063 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:01.475031 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:02.013244 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:02.013199 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:02.710051 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:02.710017 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:02.812470 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:02.812438 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:05.475224 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:05.475191 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:05.574280 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:05.574244 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:05.656104 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:05.656073 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:06.244453 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:06.244422 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:06.346217 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:06.346179 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:06.724086 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:06.724055 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:09.986902 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:09.986866 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:18.756384 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:18.756348 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:18.858361 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:18.858325 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:27.094061 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:27.094023 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:27.200040 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:27.199998 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:37.882895 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:37.882814 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:42.970063 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:42.970024 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:43.030240 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:43.030207 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:17:45.975921 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:17:45.975868 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:18:03.686682 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:18:03.686643 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:18:34.633130 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:18:34.633052 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:19:25.842540 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:19:25.842501 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:19:27.678495 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:19:27.678463 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:19:27.683808 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:19:27.683788 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:19:49.248114 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:19:49.248078 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:20:00.067081 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:20:00.067029 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:20:02.919539 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:20:02.919511 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:20:03.749460 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:20:03.749427 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:20:04.957693 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:20:04.957654 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:20:07.271721 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:20:07.271687 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:20:30.782320 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:20:30.782283 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:20:30.845357 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:20:30.845323 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:20:48.843545 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:20:48.843505 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:21:38.406720 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:21:38.406616 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:21:39.251584 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:21:39.251533 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:21:58.677760 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:21:58.677722 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:22:01.131426 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:22:01.131391 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:22:01.232090 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:22:01.232056 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:22:19.492842 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:22:19.492796 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:22:19.732084 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:22:19.732050 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:22:26.085086 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:22:26.085044 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:22:28.072563 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:22:28.072528 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:22:28.169680 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:22:28.169650 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:13.743240 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:13.743200 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:14.741870 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:14.741796 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:15.688749 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:15.688716 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7504-140612647755568"] Jul 14 00:23:15.692290 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:15.692273 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647755568" Jul 14 00:23:15.696212 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:15.696179 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-9295c\"" Jul 14 00:23:15.701576 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:15.701545 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647755568"] Jul 14 00:23:15.807326 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:15.807282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn7p5\" (UniqueName: \"kubernetes.io/projected/1eae38e9-df5a-4596-9b91-2bfb9d7b244a-kube-api-access-hn7p5\") pod \"test-curl-7504-140612647755568\" (UID: \"1eae38e9-df5a-4596-9b91-2bfb9d7b244a\") " pod="openshift-ingress/test-curl-7504-140612647755568" Jul 14 00:23:15.908848 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:15.908792 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn7p5\" (UniqueName: \"kubernetes.io/projected/1eae38e9-df5a-4596-9b91-2bfb9d7b244a-kube-api-access-hn7p5\") pod \"test-curl-7504-140612647755568\" (UID: \"1eae38e9-df5a-4596-9b91-2bfb9d7b244a\") " pod="openshift-ingress/test-curl-7504-140612647755568" Jul 14 00:23:15.917680 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:15.917656 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn7p5\" (UniqueName: \"kubernetes.io/projected/1eae38e9-df5a-4596-9b91-2bfb9d7b244a-kube-api-access-hn7p5\") pod \"test-curl-7504-140612647755568\" (UID: \"1eae38e9-df5a-4596-9b91-2bfb9d7b244a\") " pod="openshift-ingress/test-curl-7504-140612647755568" Jul 14 00:23:16.007149 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:16.007081 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647755568" Jul 14 00:23:16.136932 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:16.136905 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647755568"] Jul 14 00:23:16.138349 ip-10-0-136-62 kubenswrapper[2557]: W0714 00:23:16.138321 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1eae38e9_df5a_4596_9b91_2bfb9d7b244a.slice/crio-5180f3a549fc301ef85028a82d244ae3df4ef9272ae25bd9ba9e59a030cb6546 WatchSource:0}: Error finding container 5180f3a549fc301ef85028a82d244ae3df4ef9272ae25bd9ba9e59a030cb6546: Status 404 returned error can't find the container with id 5180f3a549fc301ef85028a82d244ae3df4ef9272ae25bd9ba9e59a030cb6546 Jul 14 00:23:16.139718 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:16.139698 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 00:23:16.631947 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:16.631907 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647755568" event={"ID":"1eae38e9-df5a-4596-9b91-2bfb9d7b244a","Type":"ContainerStarted","Data":"5180f3a549fc301ef85028a82d244ae3df4ef9272ae25bd9ba9e59a030cb6546"} Jul 14 00:23:17.638623 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:17.638590 2557 generic.go:356] "Generic (PLEG): container finished" podID="1eae38e9-df5a-4596-9b91-2bfb9d7b244a" containerID="0707163589d0ca929b1a38d08e3b099cf2bd8031efcfe5b3283da28953d9c8f9" exitCode=0 Jul 14 00:23:17.639081 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:17.638648 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647755568" event={"ID":"1eae38e9-df5a-4596-9b91-2bfb9d7b244a","Type":"ContainerDied","Data":"0707163589d0ca929b1a38d08e3b099cf2bd8031efcfe5b3283da28953d9c8f9"} Jul 14 00:23:18.790407 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.790376 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647755568" Jul 14 00:23:18.809365 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.809343 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7504-140612647755568_1eae38e9-df5a-4596-9b91-2bfb9d7b244a/test-curl-7504-140612647755568/0.log" Jul 14 00:23:18.831974 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.831945 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7504-140612647755568"] Jul 14 00:23:18.834121 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.834100 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7504-140612647755568"] Jul 14 00:23:18.936434 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.936353 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn7p5\" (UniqueName: \"kubernetes.io/projected/1eae38e9-df5a-4596-9b91-2bfb9d7b244a-kube-api-access-hn7p5\") pod \"1eae38e9-df5a-4596-9b91-2bfb9d7b244a\" (UID: \"1eae38e9-df5a-4596-9b91-2bfb9d7b244a\") " Jul 14 00:23:18.938503 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.938469 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eae38e9-df5a-4596-9b91-2bfb9d7b244a-kube-api-access-hn7p5" (OuterVolumeSpecName: "kube-api-access-hn7p5") pod "1eae38e9-df5a-4596-9b91-2bfb9d7b244a" (UID: "1eae38e9-df5a-4596-9b91-2bfb9d7b244a"). InnerVolumeSpecName "kube-api-access-hn7p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:23:18.957245 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.957221 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7504-140612647056432"] Jul 14 00:23:18.957623 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.957611 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eae38e9-df5a-4596-9b91-2bfb9d7b244a" containerName="test-curl-7504-140612647755568" Jul 14 00:23:18.957666 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.957625 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eae38e9-df5a-4596-9b91-2bfb9d7b244a" containerName="test-curl-7504-140612647755568" Jul 14 00:23:18.957700 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.957690 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eae38e9-df5a-4596-9b91-2bfb9d7b244a" containerName="test-curl-7504-140612647755568" Jul 14 00:23:18.960683 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.960668 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647056432" Jul 14 00:23:18.968088 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:18.967990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647056432"] Jul 14 00:23:19.037520 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.037483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txj8k\" (UniqueName: \"kubernetes.io/projected/c689d8db-f37f-4866-8b7f-dbb155eb7361-kube-api-access-txj8k\") pod \"test-curl-7504-140612647056432\" (UID: \"c689d8db-f37f-4866-8b7f-dbb155eb7361\") " pod="openshift-ingress/test-curl-7504-140612647056432" Jul 14 00:23:19.037692 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.037547 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn7p5\" (UniqueName: \"kubernetes.io/projected/1eae38e9-df5a-4596-9b91-2bfb9d7b244a-kube-api-access-hn7p5\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 14 00:23:19.138507 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.138462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txj8k\" (UniqueName: \"kubernetes.io/projected/c689d8db-f37f-4866-8b7f-dbb155eb7361-kube-api-access-txj8k\") pod \"test-curl-7504-140612647056432\" (UID: \"c689d8db-f37f-4866-8b7f-dbb155eb7361\") " pod="openshift-ingress/test-curl-7504-140612647056432" Jul 14 00:23:19.147615 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.147581 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txj8k\" (UniqueName: \"kubernetes.io/projected/c689d8db-f37f-4866-8b7f-dbb155eb7361-kube-api-access-txj8k\") pod \"test-curl-7504-140612647056432\" (UID: \"c689d8db-f37f-4866-8b7f-dbb155eb7361\") " pod="openshift-ingress/test-curl-7504-140612647056432" Jul 14 00:23:19.271333 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.271260 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647056432" Jul 14 00:23:19.400183 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.400156 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647056432"] Jul 14 00:23:19.401366 ip-10-0-136-62 kubenswrapper[2557]: W0714 00:23:19.401342 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc689d8db_f37f_4866_8b7f_dbb155eb7361.slice/crio-0af4e13933713e8e3920d954b326ec5eebd4f884e4d1af8aeb2fa2057f194751 WatchSource:0}: Error finding container 0af4e13933713e8e3920d954b326ec5eebd4f884e4d1af8aeb2fa2057f194751: Status 404 returned error can't find the container with id 0af4e13933713e8e3920d954b326ec5eebd4f884e4d1af8aeb2fa2057f194751 Jul 14 00:23:19.516552 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.516523 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eae38e9-df5a-4596-9b91-2bfb9d7b244a" path="/var/lib/kubelet/pods/1eae38e9-df5a-4596-9b91-2bfb9d7b244a/volumes" Jul 14 00:23:19.654358 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.654336 2557 scope.go:117] "RemoveContainer" containerID="0707163589d0ca929b1a38d08e3b099cf2bd8031efcfe5b3283da28953d9c8f9" Jul 14 00:23:19.654540 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.654336 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647755568" Jul 14 00:23:19.655584 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:19.655487 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647056432" event={"ID":"c689d8db-f37f-4866-8b7f-dbb155eb7361","Type":"ContainerStarted","Data":"0af4e13933713e8e3920d954b326ec5eebd4f884e4d1af8aeb2fa2057f194751"} Jul 14 00:23:20.663349 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:20.663314 2557 generic.go:356] "Generic (PLEG): container finished" podID="c689d8db-f37f-4866-8b7f-dbb155eb7361" containerID="4dd9792b8156a4f5bf39e4a0c5a3fb0aad6b24786c431c0a4eba1022654cfc81" exitCode=0 Jul 14 00:23:20.663717 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:20.663401 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647056432" event={"ID":"c689d8db-f37f-4866-8b7f-dbb155eb7361","Type":"ContainerDied","Data":"4dd9792b8156a4f5bf39e4a0c5a3fb0aad6b24786c431c0a4eba1022654cfc81"} Jul 14 00:23:21.804866 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:21.804840 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647056432" Jul 14 00:23:21.823962 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:21.823939 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7504-140612647056432_c689d8db-f37f-4866-8b7f-dbb155eb7361/test-curl-7504-140612647056432/0.log" Jul 14 00:23:21.848543 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:21.848513 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7504-140612647056432"] Jul 14 00:23:21.852222 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:21.852192 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7504-140612647056432"] Jul 14 00:23:21.862123 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:21.862100 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txj8k\" (UniqueName: \"kubernetes.io/projected/c689d8db-f37f-4866-8b7f-dbb155eb7361-kube-api-access-txj8k\") pod \"c689d8db-f37f-4866-8b7f-dbb155eb7361\" (UID: \"c689d8db-f37f-4866-8b7f-dbb155eb7361\") " Jul 14 00:23:21.864157 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:21.864131 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c689d8db-f37f-4866-8b7f-dbb155eb7361-kube-api-access-txj8k" (OuterVolumeSpecName: "kube-api-access-txj8k") pod "c689d8db-f37f-4866-8b7f-dbb155eb7361" (UID: "c689d8db-f37f-4866-8b7f-dbb155eb7361"). InnerVolumeSpecName "kube-api-access-txj8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:23:21.963191 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:21.963112 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txj8k\" (UniqueName: \"kubernetes.io/projected/c689d8db-f37f-4866-8b7f-dbb155eb7361-kube-api-access-txj8k\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 14 00:23:22.010084 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.010052 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:22.010448 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.010436 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c689d8db-f37f-4866-8b7f-dbb155eb7361" containerName="test-curl-7504-140612647056432" Jul 14 00:23:22.010494 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.010449 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c689d8db-f37f-4866-8b7f-dbb155eb7361" containerName="test-curl-7504-140612647056432" Jul 14 00:23:22.010529 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.010513 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c689d8db-f37f-4866-8b7f-dbb155eb7361" containerName="test-curl-7504-140612647056432" Jul 14 00:23:22.013679 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.013663 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:22.019944 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.019919 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:22.064183 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.064153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrh9\" (UniqueName: \"kubernetes.io/projected/0146993c-c801-4660-9d48-ec6d9b0ae5c5-kube-api-access-9vrh9\") pod \"test-curl-7504-140612647084080\" (UID: \"0146993c-c801-4660-9d48-ec6d9b0ae5c5\") " pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:22.165576 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.165535 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrh9\" (UniqueName: \"kubernetes.io/projected/0146993c-c801-4660-9d48-ec6d9b0ae5c5-kube-api-access-9vrh9\") pod \"test-curl-7504-140612647084080\" (UID: \"0146993c-c801-4660-9d48-ec6d9b0ae5c5\") " pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:22.177867 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.177812 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrh9\" (UniqueName: \"kubernetes.io/projected/0146993c-c801-4660-9d48-ec6d9b0ae5c5-kube-api-access-9vrh9\") pod \"test-curl-7504-140612647084080\" (UID: \"0146993c-c801-4660-9d48-ec6d9b0ae5c5\") " pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:22.323079 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.323055 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:22.455498 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.455469 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:22.456703 ip-10-0-136-62 kubenswrapper[2557]: W0714 00:23:22.456678 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0146993c_c801_4660_9d48_ec6d9b0ae5c5.slice/crio-d7e8c164140b46459c105548da1100763e09b32ca9a2b2a217077b917b20d59a WatchSource:0}: Error finding container d7e8c164140b46459c105548da1100763e09b32ca9a2b2a217077b917b20d59a: Status 404 returned error can't find the container with id d7e8c164140b46459c105548da1100763e09b32ca9a2b2a217077b917b20d59a Jul 14 00:23:22.675210 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.675127 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647056432" Jul 14 00:23:22.675210 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.675175 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0af4e13933713e8e3920d954b326ec5eebd4f884e4d1af8aeb2fa2057f194751" Jul 14 00:23:22.677002 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:22.676975 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647084080" event={"ID":"0146993c-c801-4660-9d48-ec6d9b0ae5c5","Type":"ContainerStarted","Data":"d7e8c164140b46459c105548da1100763e09b32ca9a2b2a217077b917b20d59a"} Jul 14 00:23:22.685777 ip-10-0-136-62 kubenswrapper[2557]: E0714 00:23:22.685750 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7504-140612647056432\" is forbidden: User \"system:node:ip-10-0-136-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-62.ec2.internal' and this object" podUID="c689d8db-f37f-4866-8b7f-dbb155eb7361" pod="openshift-ingress/test-curl-7504-140612647056432" Jul 14 00:23:23.516555 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:23.516521 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c689d8db-f37f-4866-8b7f-dbb155eb7361" path="/var/lib/kubelet/pods/c689d8db-f37f-4866-8b7f-dbb155eb7361/volumes" Jul 14 00:23:23.684078 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:23.684045 2557 generic.go:356] "Generic (PLEG): container finished" podID="0146993c-c801-4660-9d48-ec6d9b0ae5c5" containerID="66ae6297ae5430f00f03ef4a71ec6f6f8ff31a873336a1e6cfeeb4cd08f09bca" exitCode=0 Jul 14 00:23:23.684247 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:23.684126 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647084080" event={"ID":"0146993c-c801-4660-9d48-ec6d9b0ae5c5","Type":"ContainerDied","Data":"66ae6297ae5430f00f03ef4a71ec6f6f8ff31a873336a1e6cfeeb4cd08f09bca"} Jul 14 00:23:24.826929 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.826904 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:24.847846 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.847442 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7504-140612647084080_0146993c-c801-4660-9d48-ec6d9b0ae5c5/test-curl-7504-140612647084080/0.log" Jul 14 00:23:24.870595 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.870567 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:24.872641 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.872630 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:24.893137 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.893115 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vrh9\" (UniqueName: \"kubernetes.io/projected/0146993c-c801-4660-9d48-ec6d9b0ae5c5-kube-api-access-9vrh9\") pod \"0146993c-c801-4660-9d48-ec6d9b0ae5c5\" (UID: \"0146993c-c801-4660-9d48-ec6d9b0ae5c5\") " Jul 14 00:23:24.895101 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.895075 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0146993c-c801-4660-9d48-ec6d9b0ae5c5-kube-api-access-9vrh9" (OuterVolumeSpecName: "kube-api-access-9vrh9") pod "0146993c-c801-4660-9d48-ec6d9b0ae5c5" (UID: "0146993c-c801-4660-9d48-ec6d9b0ae5c5"). InnerVolumeSpecName "kube-api-access-9vrh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:23:24.991371 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.991312 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:24.991712 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.991700 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0146993c-c801-4660-9d48-ec6d9b0ae5c5" containerName="test-curl-7504-140612647084080" Jul 14 00:23:24.991754 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.991715 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0146993c-c801-4660-9d48-ec6d9b0ae5c5" containerName="test-curl-7504-140612647084080" Jul 14 00:23:24.991794 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.991785 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0146993c-c801-4660-9d48-ec6d9b0ae5c5" containerName="test-curl-7504-140612647084080" Jul 14 00:23:24.994328 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.994308 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vrh9\" (UniqueName: \"kubernetes.io/projected/0146993c-c801-4660-9d48-ec6d9b0ae5c5-kube-api-access-9vrh9\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 14 00:23:24.994905 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:24.994889 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:25.001570 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.001550 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:25.095064 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.095029 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9zxs\" (UniqueName: \"kubernetes.io/projected/7e3c8309-c566-4a34-a631-1aef9ed27a76-kube-api-access-v9zxs\") pod \"test-curl-7504-140612647084080\" (UID: \"7e3c8309-c566-4a34-a631-1aef9ed27a76\") " pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:25.196149 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.196122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9zxs\" (UniqueName: \"kubernetes.io/projected/7e3c8309-c566-4a34-a631-1aef9ed27a76-kube-api-access-v9zxs\") pod \"test-curl-7504-140612647084080\" (UID: \"7e3c8309-c566-4a34-a631-1aef9ed27a76\") " pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:25.205370 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.205348 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9zxs\" (UniqueName: \"kubernetes.io/projected/7e3c8309-c566-4a34-a631-1aef9ed27a76-kube-api-access-v9zxs\") pod \"test-curl-7504-140612647084080\" (UID: \"7e3c8309-c566-4a34-a631-1aef9ed27a76\") " pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:25.304945 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.304882 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:25.431626 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.431601 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:25.433011 ip-10-0-136-62 kubenswrapper[2557]: W0714 00:23:25.432983 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e3c8309_c566_4a34_a631_1aef9ed27a76.slice/crio-533a93b8287beaa72446cd2ce35fb64844f66dbfc80409fdb540e5cb560caf6c WatchSource:0}: Error finding container 533a93b8287beaa72446cd2ce35fb64844f66dbfc80409fdb540e5cb560caf6c: Status 404 returned error can't find the container with id 533a93b8287beaa72446cd2ce35fb64844f66dbfc80409fdb540e5cb560caf6c Jul 14 00:23:25.517111 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.517082 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0146993c-c801-4660-9d48-ec6d9b0ae5c5" path="/var/lib/kubelet/pods/0146993c-c801-4660-9d48-ec6d9b0ae5c5/volumes" Jul 14 00:23:25.695555 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.695529 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:25.695555 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.695551 2557 scope.go:117] "RemoveContainer" containerID="66ae6297ae5430f00f03ef4a71ec6f6f8ff31a873336a1e6cfeeb4cd08f09bca" Jul 14 00:23:25.696926 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:25.696853 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647084080" event={"ID":"7e3c8309-c566-4a34-a631-1aef9ed27a76","Type":"ContainerStarted","Data":"533a93b8287beaa72446cd2ce35fb64844f66dbfc80409fdb540e5cb560caf6c"} Jul 14 00:23:26.704206 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:26.704173 2557 generic.go:356] "Generic (PLEG): container finished" podID="7e3c8309-c566-4a34-a631-1aef9ed27a76" containerID="af1beb8463eb4adacb94a03e43871f70e6bbed6f9c8ae00e6d001fe0bbac35df" exitCode=0 Jul 14 00:23:26.704634 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:26.704259 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647084080" event={"ID":"7e3c8309-c566-4a34-a631-1aef9ed27a76","Type":"ContainerDied","Data":"af1beb8463eb4adacb94a03e43871f70e6bbed6f9c8ae00e6d001fe0bbac35df"} Jul 14 00:23:27.851669 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:27.851645 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:27.873360 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:27.873308 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7504-140612647084080_7e3c8309-c566-4a34-a631-1aef9ed27a76/test-curl-7504-140612647084080/0.log" Jul 14 00:23:27.897604 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:27.897572 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:27.901586 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:27.901563 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7504-140612647084080"] Jul 14 00:23:27.918973 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:27.918950 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9zxs\" (UniqueName: \"kubernetes.io/projected/7e3c8309-c566-4a34-a631-1aef9ed27a76-kube-api-access-v9zxs\") pod \"7e3c8309-c566-4a34-a631-1aef9ed27a76\" (UID: \"7e3c8309-c566-4a34-a631-1aef9ed27a76\") " Jul 14 00:23:27.920954 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:27.920930 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e3c8309-c566-4a34-a631-1aef9ed27a76-kube-api-access-v9zxs" (OuterVolumeSpecName: "kube-api-access-v9zxs") pod "7e3c8309-c566-4a34-a631-1aef9ed27a76" (UID: "7e3c8309-c566-4a34-a631-1aef9ed27a76"). InnerVolumeSpecName "kube-api-access-v9zxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:23:28.019924 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.019815 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9zxs\" (UniqueName: \"kubernetes.io/projected/7e3c8309-c566-4a34-a631-1aef9ed27a76-kube-api-access-v9zxs\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 14 00:23:28.021976 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.021954 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7504-140612647085088"] Jul 14 00:23:28.022354 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.022342 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3c8309-c566-4a34-a631-1aef9ed27a76" containerName="test-curl-7504-140612647084080" Jul 14 00:23:28.022388 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.022356 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3c8309-c566-4a34-a631-1aef9ed27a76" containerName="test-curl-7504-140612647084080" Jul 14 00:23:28.022449 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.022439 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3c8309-c566-4a34-a631-1aef9ed27a76" containerName="test-curl-7504-140612647084080" Jul 14 00:23:28.025426 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.025409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647085088" Jul 14 00:23:28.031233 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.031208 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647085088"] Jul 14 00:23:28.121018 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.120977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hszpb\" (UniqueName: \"kubernetes.io/projected/6f7d9b66-a491-4688-9e14-d6e78e23eb23-kube-api-access-hszpb\") pod \"test-curl-7504-140612647085088\" (UID: \"6f7d9b66-a491-4688-9e14-d6e78e23eb23\") " pod="openshift-ingress/test-curl-7504-140612647085088" Jul 14 00:23:28.222399 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.222358 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hszpb\" (UniqueName: \"kubernetes.io/projected/6f7d9b66-a491-4688-9e14-d6e78e23eb23-kube-api-access-hszpb\") pod \"test-curl-7504-140612647085088\" (UID: \"6f7d9b66-a491-4688-9e14-d6e78e23eb23\") " pod="openshift-ingress/test-curl-7504-140612647085088" Jul 14 00:23:28.231684 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.231660 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hszpb\" (UniqueName: \"kubernetes.io/projected/6f7d9b66-a491-4688-9e14-d6e78e23eb23-kube-api-access-hszpb\") pod \"test-curl-7504-140612647085088\" (UID: \"6f7d9b66-a491-4688-9e14-d6e78e23eb23\") " pod="openshift-ingress/test-curl-7504-140612647085088" Jul 14 00:23:28.335874 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.335845 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647085088" Jul 14 00:23:28.463807 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.463784 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-140612647085088"] Jul 14 00:23:28.465634 ip-10-0-136-62 kubenswrapper[2557]: W0714 00:23:28.465607 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f7d9b66_a491_4688_9e14_d6e78e23eb23.slice/crio-0151ade84b08a3a8d355b20995f2b5ba1df98e4861ca6179abf18d10c4d42ce3 WatchSource:0}: Error finding container 0151ade84b08a3a8d355b20995f2b5ba1df98e4861ca6179abf18d10c4d42ce3: Status 404 returned error can't find the container with id 0151ade84b08a3a8d355b20995f2b5ba1df98e4861ca6179abf18d10c4d42ce3 Jul 14 00:23:28.716294 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.716213 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:28.716451 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.716212 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="533a93b8287beaa72446cd2ce35fb64844f66dbfc80409fdb540e5cb560caf6c" Jul 14 00:23:28.717314 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:28.717290 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647085088" event={"ID":"6f7d9b66-a491-4688-9e14-d6e78e23eb23","Type":"ContainerStarted","Data":"0151ade84b08a3a8d355b20995f2b5ba1df98e4861ca6179abf18d10c4d42ce3"} Jul 14 00:23:28.726693 ip-10-0-136-62 kubenswrapper[2557]: E0714 00:23:28.726667 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7504-140612647084080\" is forbidden: User \"system:node:ip-10-0-136-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-62.ec2.internal' and this object" podUID="7e3c8309-c566-4a34-a631-1aef9ed27a76" pod="openshift-ingress/test-curl-7504-140612647084080" Jul 14 00:23:29.516683 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:29.516649 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e3c8309-c566-4a34-a631-1aef9ed27a76" path="/var/lib/kubelet/pods/7e3c8309-c566-4a34-a631-1aef9ed27a76/volumes" Jul 14 00:23:29.724450 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:29.724409 2557 generic.go:356] "Generic (PLEG): container finished" podID="6f7d9b66-a491-4688-9e14-d6e78e23eb23" containerID="d525fe0a175be85ffbaa3ba8aa58afa7808a9867cf520d2526e167e45d7cd73c" exitCode=0 Jul 14 00:23:29.724625 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:29.724498 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-140612647085088" event={"ID":"6f7d9b66-a491-4688-9e14-d6e78e23eb23","Type":"ContainerDied","Data":"d525fe0a175be85ffbaa3ba8aa58afa7808a9867cf520d2526e167e45d7cd73c"} Jul 14 00:23:30.891485 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:30.891459 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647085088" Jul 14 00:23:30.910519 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:30.910495 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7504-140612647085088_6f7d9b66-a491-4688-9e14-d6e78e23eb23/test-curl-7504-140612647085088/0.log" Jul 14 00:23:30.934032 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:30.934006 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7504-140612647085088"] Jul 14 00:23:30.936413 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:30.936391 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7504-140612647085088"] Jul 14 00:23:30.967148 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:30.967115 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hszpb\" (UniqueName: \"kubernetes.io/projected/6f7d9b66-a491-4688-9e14-d6e78e23eb23-kube-api-access-hszpb\") pod \"6f7d9b66-a491-4688-9e14-d6e78e23eb23\" (UID: \"6f7d9b66-a491-4688-9e14-d6e78e23eb23\") " Jul 14 00:23:30.969138 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:30.969114 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f7d9b66-a491-4688-9e14-d6e78e23eb23-kube-api-access-hszpb" (OuterVolumeSpecName: "kube-api-access-hszpb") pod "6f7d9b66-a491-4688-9e14-d6e78e23eb23" (UID: "6f7d9b66-a491-4688-9e14-d6e78e23eb23"). InnerVolumeSpecName "kube-api-access-hszpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 00:23:31.068773 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:31.068746 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hszpb\" (UniqueName: \"kubernetes.io/projected/6f7d9b66-a491-4688-9e14-d6e78e23eb23-kube-api-access-hszpb\") on node \"ip-10-0-136-62.ec2.internal\" DevicePath \"\"" Jul 14 00:23:31.516414 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:31.516337 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f7d9b66-a491-4688-9e14-d6e78e23eb23" path="/var/lib/kubelet/pods/6f7d9b66-a491-4688-9e14-d6e78e23eb23/volumes" Jul 14 00:23:31.737575 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:31.737545 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-140612647085088" Jul 14 00:23:31.737737 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:31.737589 2557 scope.go:117] "RemoveContainer" containerID="d525fe0a175be85ffbaa3ba8aa58afa7808a9867cf520d2526e167e45d7cd73c" Jul 14 00:23:34.502953 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:34.502917 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:34.600340 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:34.600305 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:44.356102 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:44.356068 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:49.021384 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:49.021342 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:54.867201 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:54.867169 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:54.936219 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:54.936186 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:59.776447 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:59.776410 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:23:59.997440 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:23:59.997405 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:00.716473 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:00.716439 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:00.822074 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:00.822041 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:10.546501 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:10.546462 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:15.206100 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:15.206063 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:21.126387 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:21.126294 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:21.226715 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:21.226678 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:25.924868 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:25.924836 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:26.171958 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:26.171925 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:27.717927 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:27.717900 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:24:27.723517 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:27.723496 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zd87m_dad32e11-f8f3-44f3-87a1-6c03fdd26a76/ovn-acl-logging/0.log" Jul 14 00:24:31.785646 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:31.785616 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wpl64_5930f51d-da11-4478-999e-c97def8f38ce/manager/0.log" Jul 14 00:24:32.170183 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:32.170158 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-s54cz_a8e0d9d3-2734-4ded-be8c-6fa4f8186874/server/0.log" Jul 14 00:24:32.535120 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:32.535035 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74bf4db56c-8np9f_2154df9d-c366-4174-a435-57468717df82/copy-manifests/0.log" Jul 14 00:24:32.548104 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:32.548073 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74bf4db56c-8np9f_2154df9d-c366-4174-a435-57468717df82/manager/0.log" Jul 14 00:24:35.733067 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.733039 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf_0ca7edc4-7f80-40f6-968d-0b0a0882a405/util/0.log" Jul 14 00:24:35.738942 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.738901 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf_0ca7edc4-7f80-40f6-968d-0b0a0882a405/pull/0.log" Jul 14 00:24:35.744577 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.744561 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf_0ca7edc4-7f80-40f6-968d-0b0a0882a405/extract/0.log" Jul 14 00:24:35.857491 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.857457 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2_a5576925-41c9-46f6-964c-4f51369bf159/util/0.log" Jul 14 00:24:35.863407 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.863385 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2_a5576925-41c9-46f6-964c-4f51369bf159/pull/0.log" Jul 14 00:24:35.868967 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.868948 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2_a5576925-41c9-46f6-964c-4f51369bf159/extract/0.log" Jul 14 00:24:35.979802 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.979774 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l_4f2b198c-eb31-4f17-bd26-b4e557d633d0/util/0.log" Jul 14 00:24:35.985896 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.985834 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l_4f2b198c-eb31-4f17-bd26-b4e557d633d0/pull/0.log" Jul 14 00:24:35.991984 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:35.991962 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l_4f2b198c-eb31-4f17-bd26-b4e557d633d0/extract/0.log" Jul 14 00:24:36.100428 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:36.100400 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c_68ab4c62-a3aa-4de5-88db-5f0649e867e2/util/0.log" Jul 14 00:24:36.106775 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:36.106749 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c_68ab4c62-a3aa-4de5-88db-5f0649e867e2/pull/0.log" Jul 14 00:24:36.116044 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:36.116027 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c_68ab4c62-a3aa-4de5-88db-5f0649e867e2/extract/0.log" Jul 14 00:24:37.766068 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:37.766038 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764dccbb5b-lbfgg_0aaec899-c97e-4795-9e85-29bb6b4c949b/kube-auth-proxy/0.log" Jul 14 00:24:38.740927 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:38.740900 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5rgd8_94af05a0-a2d2-46a8-9953-1722d38a0803/main/0.log" Jul 14 00:24:38.979755 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:38.979727 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5rbgt_7afcfcfd-2c7e-4d22-a10a-573952d33dcf/main/0.log" Jul 14 00:24:39.096008 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:39.095978 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6s9kp_480253af-299d-48c3-8699-515f03b9949c/main/0.log" Jul 14 00:24:39.209161 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:39.209137 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-65lbb_2112db6e-1a89-4061-be36-4b8d56d5ad9a/main/0.log" Jul 14 00:24:39.845573 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:39.845543 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:43.070134 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:43.070088 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:43.168504 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:43.168468 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" limit=1024 Jul 14 00:24:45.982096 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:45.982058 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5vtl5_6bcab85d-5d09-44f9-906a-f2a1a9455253/global-pull-secret-syncer/0.log" Jul 14 00:24:46.071529 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:46.071498 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kmrss_8b6719fb-cecc-47f8-a1da-67ebee71253d/konnectivity-agent/0.log" Jul 14 00:24:46.191700 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:46.191662 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-62.ec2.internal_e4da66e21bfcdc736ed59a24d3007918/haproxy/0.log" Jul 14 00:24:50.396308 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.396279 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf_0ca7edc4-7f80-40f6-968d-0b0a0882a405/extract/0.log" Jul 14 00:24:50.423594 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.423567 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf_0ca7edc4-7f80-40f6-968d-0b0a0882a405/util/0.log" Jul 14 00:24:50.440533 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.440511 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hbxkf_0ca7edc4-7f80-40f6-968d-0b0a0882a405/pull/0.log" Jul 14 00:24:50.491059 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.491038 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2_a5576925-41c9-46f6-964c-4f51369bf159/extract/0.log" Jul 14 00:24:50.512903 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.512876 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2_a5576925-41c9-46f6-964c-4f51369bf159/util/0.log" Jul 14 00:24:50.533180 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.533145 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tm4p2_a5576925-41c9-46f6-964c-4f51369bf159/pull/0.log" Jul 14 00:24:50.561827 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.561806 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l_4f2b198c-eb31-4f17-bd26-b4e557d633d0/extract/0.log" Jul 14 00:24:50.581401 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.581381 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l_4f2b198c-eb31-4f17-bd26-b4e557d633d0/util/0.log" Jul 14 00:24:50.606948 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.606930 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732x24l_4f2b198c-eb31-4f17-bd26-b4e557d633d0/pull/0.log" Jul 14 00:24:50.636626 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.636610 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c_68ab4c62-a3aa-4de5-88db-5f0649e867e2/extract/0.log" Jul 14 00:24:50.663331 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.663277 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c_68ab4c62-a3aa-4de5-88db-5f0649e867e2/util/0.log" Jul 14 00:24:50.688375 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:50.688356 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j6v4c_68ab4c62-a3aa-4de5-88db-5f0649e867e2/pull/0.log" Jul 14 00:24:53.107694 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.107665 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5add1f37-01b9-4d4c-afe0-960250fe22f4/alertmanager/0.log" Jul 14 00:24:53.131328 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.131300 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5add1f37-01b9-4d4c-afe0-960250fe22f4/config-reloader/0.log" Jul 14 00:24:53.153832 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.153793 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5add1f37-01b9-4d4c-afe0-960250fe22f4/kube-rbac-proxy-web/0.log" Jul 14 00:24:53.180162 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.180142 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5add1f37-01b9-4d4c-afe0-960250fe22f4/kube-rbac-proxy/0.log" Jul 14 00:24:53.210996 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.210971 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5add1f37-01b9-4d4c-afe0-960250fe22f4/kube-rbac-proxy-metric/0.log" Jul 14 00:24:53.240100 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.240076 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5add1f37-01b9-4d4c-afe0-960250fe22f4/prom-label-proxy/0.log" Jul 14 00:24:53.266056 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.266033 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5add1f37-01b9-4d4c-afe0-960250fe22f4/init-config-reloader/0.log" Jul 14 00:24:53.331860 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.331816 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kqbfm_1c25cf18-e2af-4413-bd8f-d61626d6f3a8/kube-state-metrics/0.log" Jul 14 00:24:53.350611 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.350586 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kqbfm_1c25cf18-e2af-4413-bd8f-d61626d6f3a8/kube-rbac-proxy-main/0.log" Jul 14 00:24:53.393804 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.393737 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kqbfm_1c25cf18-e2af-4413-bd8f-d61626d6f3a8/kube-rbac-proxy-self/0.log" Jul 14 00:24:53.424931 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.424911 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fcc555d94-8wl78_f229cb40-f8c1-4b59-8b3c-a281d01937bc/metrics-server/0.log" Jul 14 00:24:53.450708 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.450680 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-bskxr_201f2783-b7ef-4b5f-80ba-e6bb274b08c8/monitoring-plugin/0.log" Jul 14 00:24:53.487741 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.487715 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wtpb_f5c509c4-3494-4e53-abd6-5d3989bd5c4f/node-exporter/0.log" Jul 14 00:24:53.511315 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.511293 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wtpb_f5c509c4-3494-4e53-abd6-5d3989bd5c4f/kube-rbac-proxy/0.log" Jul 14 00:24:53.533730 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.533711 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wtpb_f5c509c4-3494-4e53-abd6-5d3989bd5c4f/init-textfile/0.log" Jul 14 00:24:53.773449 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.773420 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-gcwdl_b79e71cf-f56e-470e-beff-70e14bbd293a/kube-rbac-proxy-main/0.log" Jul 14 00:24:53.795254 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.795228 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-gcwdl_b79e71cf-f56e-470e-beff-70e14bbd293a/kube-rbac-proxy-self/0.log" Jul 14 00:24:53.815680 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:53.815661 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-gcwdl_b79e71cf-f56e-470e-beff-70e14bbd293a/openshift-state-metrics/0.log" Jul 14 00:24:54.026059 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.025984 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-jb4w2_c91f5a09-3b59-4458-a1a7-bb248d2c94ca/prometheus-operator/0.log" Jul 14 00:24:54.047679 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.047650 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-jb4w2_c91f5a09-3b59-4458-a1a7-bb248d2c94ca/kube-rbac-proxy/0.log" Jul 14 00:24:54.070670 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.070648 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-xcs75_3c9d6aaf-40ea-42cc-bee3-e44c28448953/prometheus-operator-admission-webhook/0.log" Jul 14 00:24:54.111096 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.111075 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bbd968f6-mlbz2_daa5ce9f-cd11-414e-8ae5-d90cb0fe2022/telemeter-client/0.log" Jul 14 00:24:54.135970 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.135950 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bbd968f6-mlbz2_daa5ce9f-cd11-414e-8ae5-d90cb0fe2022/reload/0.log" Jul 14 00:24:54.156676 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.156654 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bbd968f6-mlbz2_daa5ce9f-cd11-414e-8ae5-d90cb0fe2022/kube-rbac-proxy/0.log" Jul 14 00:24:54.191240 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.191221 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689769859f-v5spb_8eb20c2c-19d0-4c94-b01e-102229118f2b/thanos-query/0.log" Jul 14 00:24:54.214449 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.214413 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689769859f-v5spb_8eb20c2c-19d0-4c94-b01e-102229118f2b/kube-rbac-proxy-web/0.log" Jul 14 00:24:54.235799 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.235776 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689769859f-v5spb_8eb20c2c-19d0-4c94-b01e-102229118f2b/kube-rbac-proxy/0.log" Jul 14 00:24:54.259327 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.259309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689769859f-v5spb_8eb20c2c-19d0-4c94-b01e-102229118f2b/prom-label-proxy/0.log" Jul 14 00:24:54.280464 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.280407 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689769859f-v5spb_8eb20c2c-19d0-4c94-b01e-102229118f2b/kube-rbac-proxy-rules/0.log" Jul 14 00:24:54.300585 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:54.300568 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689769859f-v5spb_8eb20c2c-19d0-4c94-b01e-102229118f2b/kube-rbac-proxy-metrics/0.log" Jul 14 00:24:56.927903 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:56.927873 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64f6bcccd5-4tzzp_051106c5-102a-4402-8bec-6e3743685dcb/console/0.log" Jul 14 00:24:57.248780 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.248698 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt"] Jul 14 00:24:57.249350 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.249233 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f7d9b66-a491-4688-9e14-d6e78e23eb23" containerName="test-curl-7504-140612647085088" Jul 14 00:24:57.249472 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.249357 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f7d9b66-a491-4688-9e14-d6e78e23eb23" containerName="test-curl-7504-140612647085088" Jul 14 00:24:57.249525 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.249480 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f7d9b66-a491-4688-9e14-d6e78e23eb23" containerName="test-curl-7504-140612647085088" Jul 14 00:24:57.252628 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.252611 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.255453 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.255436 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kbgg9\"/\"kube-root-ca.crt\"" Jul 14 00:24:57.256400 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.256383 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kbgg9\"/\"default-dockercfg-5fbwc\"" Jul 14 00:24:57.256459 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.256383 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kbgg9\"/\"openshift-service-ca.crt\"" Jul 14 00:24:57.271168 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.271142 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt"] Jul 14 00:24:57.345525 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.345488 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-podres\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.345525 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.345529 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-sys\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.345706 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.345610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-proc\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.345706 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.345636 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k7lf\" (UniqueName: \"kubernetes.io/projected/60439ee1-aff5-4dab-bb44-37e964866d81-kube-api-access-2k7lf\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.345706 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.345657 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-lib-modules\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446183 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446150 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-proc\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446183 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k7lf\" (UniqueName: \"kubernetes.io/projected/60439ee1-aff5-4dab-bb44-37e964866d81-kube-api-access-2k7lf\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446436 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446207 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-lib-modules\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446436 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446251 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-podres\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446436 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-sys\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446436 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446285 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-proc\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446436 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446340 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-sys\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446436 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446403 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-lib-modules\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.446436 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.446402 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60439ee1-aff5-4dab-bb44-37e964866d81-podres\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.455026 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.455005 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k7lf\" (UniqueName: \"kubernetes.io/projected/60439ee1-aff5-4dab-bb44-37e964866d81-kube-api-access-2k7lf\") pod \"perf-node-gather-daemonset-6fczt\" (UID: \"60439ee1-aff5-4dab-bb44-37e964866d81\") " pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.563222 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.563199 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:57.708035 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:57.708009 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt"] Jul 14 00:24:57.710233 ip-10-0-136-62 kubenswrapper[2557]: W0714 00:24:57.710200 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod60439ee1_aff5_4dab_bb44_37e964866d81.slice/crio-fc51b80059d3c55a473e7f594600ea866c42a9dc7c52f9d0f23868b8e7415973 WatchSource:0}: Error finding container fc51b80059d3c55a473e7f594600ea866c42a9dc7c52f9d0f23868b8e7415973: Status 404 returned error can't find the container with id fc51b80059d3c55a473e7f594600ea866c42a9dc7c52f9d0f23868b8e7415973 Jul 14 00:24:58.225170 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:58.225063 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" event={"ID":"60439ee1-aff5-4dab-bb44-37e964866d81","Type":"ContainerStarted","Data":"82b8fff31b1e43f50c5411e888a1238fe80650f540f33ff01bad2cb1633e5d75"} Jul 14 00:24:58.225170 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:58.225120 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" event={"ID":"60439ee1-aff5-4dab-bb44-37e964866d81","Type":"ContainerStarted","Data":"fc51b80059d3c55a473e7f594600ea866c42a9dc7c52f9d0f23868b8e7415973"} Jul 14 00:24:58.225617 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:58.225213 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:24:58.241456 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:58.241404 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" podStartSLOduration=1.2413906670000001 podStartE2EDuration="1.241390667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:24:58.240567908 +0000 UTC m=+2731.208263771" watchObservedRunningTime="2026-07-14 00:24:58.241390667 +0000 UTC m=+2731.209086517" Jul 14 00:24:58.820007 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:58.819977 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rklhs_12fca644-415a-4c91-a463-22117539941b/dns/0.log" Jul 14 00:24:58.841564 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:58.841535 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rklhs_12fca644-415a-4c91-a463-22117539941b/kube-rbac-proxy/0.log" Jul 14 00:24:58.956945 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:58.956915 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vs9qk_f6627cc2-5cf1-44ff-af0d-7ad75a669105/dns-node-resolver/0.log" Jul 14 00:24:59.560887 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:24:59.560860 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gscfc_69b77072-2f31-4b3b-9411-c3647d1d2b90/node-ca/0.log" Jul 14 00:25:00.789529 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:00.789500 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764dccbb5b-lbfgg_0aaec899-c97e-4795-9e85-29bb6b4c949b/kube-auth-proxy/0.log" Jul 14 00:25:01.743813 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:01.743782 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lrxjb_474181f5-67e9-4645-aa60-cfef7b205721/serve-healthcheck-canary/0.log" Jul 14 00:25:02.395303 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:02.395276 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rtkb2_9398136e-98f7-40c8-b579-bf968ff72c82/kube-rbac-proxy/0.log" Jul 14 00:25:02.414847 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:02.414814 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rtkb2_9398136e-98f7-40c8-b579-bf968ff72c82/exporter/0.log" Jul 14 00:25:02.434545 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:02.434521 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rtkb2_9398136e-98f7-40c8-b579-bf968ff72c82/extractor/0.log" Jul 14 00:25:04.241021 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:04.240980 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kbgg9/perf-node-gather-daemonset-6fczt" Jul 14 00:25:04.530866 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:04.530765 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wpl64_5930f51d-da11-4478-999e-c97def8f38ce/manager/0.log" Jul 14 00:25:04.903584 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:04.903560 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-s54cz_a8e0d9d3-2734-4ded-be8c-6fa4f8186874/server/0.log" Jul 14 00:25:05.122742 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:05.122703 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74bf4db56c-8np9f_2154df9d-c366-4174-a435-57468717df82/manager/0.log" Jul 14 00:25:05.138653 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:05.138627 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74bf4db56c-8np9f_2154df9d-c366-4174-a435-57468717df82/copy-manifests/0.log" Jul 14 00:25:06.508367 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:06.508337 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dc78dff7b-594xh_4c1ccc35-bcb1-4a2e-aad8-855cef898ce6/manager/0.log" Jul 14 00:25:06.558378 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:06.558356 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pc85w_36d84143-88bf-42fd-aaa1-e02f98c69b14/openshift-lws-operator/0.log" Jul 14 00:25:08.211211 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:08.211181 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764dccbb5b-lbfgg_0aaec899-c97e-4795-9e85-29bb6b4c949b/kube-auth-proxy/0.log" Jul 14 00:25:10.008264 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:10.008220 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-764dccbb5b-lbfgg_0aaec899-c97e-4795-9e85-29bb6b4c949b/kube-auth-proxy/0.log" Jul 14 00:25:13.324642 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.324613 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8wgn2_0117ae8c-bf88-404d-9adf-025edbd8afb2/kube-multus/0.log" Jul 14 00:25:13.656866 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.656775 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snlc4_219c1d5e-bc7c-4608-816e-982173569fa7/kube-multus-additional-cni-plugins/0.log" Jul 14 00:25:13.676804 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.676776 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snlc4_219c1d5e-bc7c-4608-816e-982173569fa7/egress-router-binary-copy/0.log" Jul 14 00:25:13.695999 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.695969 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snlc4_219c1d5e-bc7c-4608-816e-982173569fa7/cni-plugins/0.log" Jul 14 00:25:13.716386 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.716358 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snlc4_219c1d5e-bc7c-4608-816e-982173569fa7/bond-cni-plugin/0.log" Jul 14 00:25:13.737380 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.737354 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snlc4_219c1d5e-bc7c-4608-816e-982173569fa7/routeoverride-cni/0.log" Jul 14 00:25:13.767072 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.767045 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snlc4_219c1d5e-bc7c-4608-816e-982173569fa7/whereabouts-cni-bincopy/0.log" Jul 14 00:25:13.833201 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.833169 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snlc4_219c1d5e-bc7c-4608-816e-982173569fa7/whereabouts-cni/0.log" Jul 14 00:25:13.974015 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.973921 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mbbz9_a062baa3-3416-400c-8bad-dd6c9379758e/network-metrics-daemon/0.log" Jul 14 00:25:13.994704 ip-10-0-136-62 kubenswrapper[2557]: I0714 00:25:13.994678 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mbbz9_a062baa3-3416-400c-8bad-dd6c9379758e/kube-rbac-proxy/0.log"