Jul 17 22:08:47.732636 ip-10-0-142-78 systemd[1]: Starting Kubernetes Kubelet... Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.118592 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123272 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123283 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123286 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123289 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123292 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123295 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123298 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 22:08:48.143643 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123302 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123305 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123307 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123310 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123313 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123316 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123319 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123322 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123325 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123339 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123343 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123345 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123348 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123351 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123354 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123357 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123360 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123364 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123366 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123370 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 22:08:48.160706 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123372 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123375 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123378 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123380 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123383 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123386 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123389 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123393 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123395 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123399 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123402 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123405 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123408 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123411 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123414 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123416 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123419 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123422 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123424 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123427 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 22:08:48.231128 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123429 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 22:08:48.211096 ip-10-0-142-78 systemd[1]: Started Kubernetes Kubelet. Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123432 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123435 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123437 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123440 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123442 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123445 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123447 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123450 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123452 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123455 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123457 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123460 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123462 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123465 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123468 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123471 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123474 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123478 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 22:08:48.235076 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123482 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123485 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123490 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123493 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123497 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123500 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123502 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123505 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123508 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123511 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123513 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123516 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123519 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123522 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123524 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123527 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123529 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123532 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123535 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 22:08:48.238161 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123537 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123540 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123542 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123545 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123547 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123550 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123552 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123555 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123558 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123560 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123564 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123568 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123571 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.123574 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124266 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124271 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124274 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124277 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124280 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124282 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 22:08:48.243021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124285 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124288 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124291 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124293 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124295 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124298 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124301 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124303 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124306 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124308 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124311 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124313 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124316 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124318 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124321 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124324 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124327 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124350 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124356 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124360 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 22:08:48.246431 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124363 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124366 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124369 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124374 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124379 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124382 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124384 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124387 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124390 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124393 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124395 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124398 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124401 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124403 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124406 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124408 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124411 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124413 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124416 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 22:08:48.250384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124419 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124421 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124424 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124427 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124430 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124433 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124435 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124438 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124441 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124444 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124446 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124449 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124452 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124454 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124457 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124459 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124462 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124465 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124471 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 22:08:48.252477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124473 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124478 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124482 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124485 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124489 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124493 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124496 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124499 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124501 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124504 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124507 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124509 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124512 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124515 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124518 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124520 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124523 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124526 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124529 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 22:08:48.256523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124531 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124534 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124536 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124539 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124542 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124544 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124546 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124549 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124551 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124554 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124558 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124560 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124571 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124573 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124576 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124579 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124934 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124938 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124941 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124944 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 22:08:48.404484 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124946 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124949 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124951 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124954 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124957 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124959 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124962 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124965 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124968 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124971 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124973 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124976 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124978 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124981 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124983 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124985 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124988 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124990 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124993 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124995 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 22:08:48.419640 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.124998 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125001 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125005 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125008 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125013 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125016 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125019 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125021 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125024 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125026 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125029 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125031 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125035 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125038 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125041 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125044 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125047 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125049 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125052 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 22:08:48.420598 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125054 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125057 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125059 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125062 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125064 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125068 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125071 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125074 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125076 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125079 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125081 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125083 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125086 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125090 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125093 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125098 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125101 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125105 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125108 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125111 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 22:08:48.421600 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125113 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125116 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125118 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125121 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125123 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125126 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125129 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125131 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125134 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125136 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125138 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125141 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125143 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125147 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125149 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125152 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125154 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125157 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125159 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125162 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 22:08:48.422630 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125164 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125167 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125169 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125171 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125174 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125176 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125179 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125184 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125186 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125191 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125194 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125197 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125200 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125202 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125205 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125207 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125275 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125282 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125287 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125291 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125295 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 22:08:48.423658 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125298 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125302 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125306 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125309 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125313 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125316 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125319 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125323 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125326 2556 flags.go:64] FLAG: --cgroup-root="" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125344 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125349 2556 flags.go:64] FLAG: --client-ca-file="" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125353 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125356 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125362 2556 flags.go:64] FLAG: --cluster-domain="" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125365 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125368 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125371 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125375 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125380 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125383 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125388 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125391 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125394 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125398 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 22:08:48.424682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125401 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125404 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125407 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125411 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125414 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125417 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125419 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125422 2556 flags.go:64] FLAG: --enable-server="true" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125425 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125429 2556 flags.go:64] FLAG: --event-burst="100" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125432 2556 flags.go:64] FLAG: --event-qps="50" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125435 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125438 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125441 2556 flags.go:64] FLAG: --eviction-hard="" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125445 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125447 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125450 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125453 2556 flags.go:64] FLAG: --eviction-soft="" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125456 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125459 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125462 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125465 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125468 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125470 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125473 2556 flags.go:64] FLAG: --feature-gates="" Jul 17 22:08:48.426200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125477 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125481 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125484 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125489 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125492 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125495 2556 flags.go:64] FLAG: --help="false" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125498 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-142-78.ec2.internal" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125502 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125505 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125508 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125511 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125514 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125517 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125520 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125523 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125526 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125528 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125532 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125534 2556 flags.go:64] FLAG: --kube-reserved="" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125537 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125540 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125543 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125546 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125549 2556 flags.go:64] FLAG: --lock-file="" Jul 17 22:08:48.427638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125552 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125555 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125557 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125562 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125565 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125568 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125571 2556 flags.go:64] FLAG: --logging-format="text" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125574 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125577 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125581 2556 flags.go:64] FLAG: --manifest-url="" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125584 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125590 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125593 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125596 2556 flags.go:64] FLAG: --max-pods="110" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125599 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125602 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125606 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125609 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125611 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125614 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125617 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125624 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125627 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125630 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 22:08:48.429474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125633 2556 flags.go:64] FLAG: --pod-cidr="" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125636 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125642 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125644 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125647 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125650 2556 flags.go:64] FLAG: --port="10250" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125653 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125656 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c330336fcc7bfe20" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125659 2556 flags.go:64] FLAG: --qos-reserved="" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125662 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125665 2556 flags.go:64] FLAG: --register-node="true" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125668 2556 flags.go:64] FLAG: --register-with-taints="" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125672 2556 flags.go:64] FLAG: --registry-burst="10" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125674 2556 flags.go:64] FLAG: --registry-qps="5" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125677 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125680 2556 flags.go:64] FLAG: --reserved-memory="" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125683 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125688 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125691 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125694 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125698 2556 flags.go:64] FLAG: --runonce="false" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125701 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125704 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125707 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125710 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 22:08:48.431796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125713 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125716 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125719 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125722 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125725 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125728 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125730 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125733 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125736 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125739 2556 flags.go:64] FLAG: --system-cgroups="" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125742 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125747 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125750 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125753 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125757 2556 flags.go:64] FLAG: --tls-min-version="" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125760 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125763 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125765 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125768 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125771 2556 flags.go:64] FLAG: --v="2" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125775 2556 flags.go:64] FLAG: --version="false" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125778 2556 flags.go:64] FLAG: --vmodule="" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125782 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.125785 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125923 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 22:08:48.433988 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125927 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125932 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125936 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125940 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125943 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125945 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125948 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125950 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125956 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125958 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125961 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125964 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125966 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125969 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125972 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125974 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125977 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125979 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125982 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125984 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 22:08:48.441040 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125987 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125989 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125992 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125994 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125997 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.125999 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126002 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126005 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126007 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126010 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126012 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126016 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126018 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126021 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126025 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126028 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126031 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126033 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126036 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126038 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 22:08:48.442053 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126041 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126044 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126046 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126049 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126052 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126055 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126057 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126060 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126062 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126065 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126067 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126070 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126073 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126075 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126078 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126081 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126084 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126086 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126089 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126092 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 22:08:48.444384 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126094 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126097 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126099 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126103 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126105 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126108 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126112 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126115 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126117 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126120 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126123 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126125 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126128 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126130 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126133 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126136 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126138 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126141 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126143 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126146 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 22:08:48.445393 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126148 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126151 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126153 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126156 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126158 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126161 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126165 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126169 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126172 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126175 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126177 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126180 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126183 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126185 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126188 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126192 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126195 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 22:08:48.446869 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.126199 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.126752 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.135803 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.135819 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.135838 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.135845 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135899 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135904 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135907 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135910 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135914 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135917 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135920 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135923 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135925 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 22:08:48.447861 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135927 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135930 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135933 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135936 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135938 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135941 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135944 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135948 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135952 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135954 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135957 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135959 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135962 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135965 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135968 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135971 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135974 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135976 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135980 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135982 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 22:08:48.454523 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135985 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135987 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135990 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135992 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135995 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.135998 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136001 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136003 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136006 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136009 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136011 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136014 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136017 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136019 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136022 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136025 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136027 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136030 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136032 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 22:08:48.455535 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136035 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136038 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136040 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136043 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136045 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136049 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136052 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136055 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136057 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136060 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136063 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136066 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136068 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136071 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136073 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136076 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136078 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136081 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136083 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136086 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 22:08:48.457389 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136088 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136091 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136094 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136096 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136099 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136101 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136104 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136106 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136109 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136111 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136115 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136119 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136122 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136125 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136128 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136130 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136133 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136138 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136141 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136144 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 22:08:48.458409 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136147 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136149 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136152 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136154 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136157 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136159 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136162 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136165 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136169 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136172 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136175 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.136180 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136289 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136294 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136297 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 22:08:48.556441 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136300 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136303 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136306 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136309 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136312 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136314 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136317 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136320 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136323 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136344 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136349 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136354 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136357 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136360 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136363 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136369 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136372 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136374 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136377 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136380 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 22:08:48.563618 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136382 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136385 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136388 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136390 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136393 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136396 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136398 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136401 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136403 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136406 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136409 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136411 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136414 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136416 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136419 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136422 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136424 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136427 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136429 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136432 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 22:08:48.564682 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136434 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136439 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136442 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136444 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136447 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136449 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136452 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136456 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136459 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136461 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136464 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136466 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136469 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136472 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136474 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136477 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136480 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136482 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136485 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136487 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 22:08:48.565671 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136490 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136493 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136495 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136498 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136501 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136504 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136507 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136509 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136512 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136514 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136517 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136519 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136522 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136526 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136528 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136532 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136535 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136538 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136542 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 22:08:48.567979 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136546 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136549 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136552 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136555 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136558 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136561 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136564 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136567 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136569 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136572 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136574 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136577 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136580 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136582 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136585 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136587 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 22:08:48.569006 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:48.136590 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.136595 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.136695 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.140105 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.141306 2556 server.go:1019] "Starting client certificate rotation" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.141363 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.141395 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.143977 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.145105 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.165162 2556 log.go:25] "Validated CRI v1 runtime API" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.167289 2556 log.go:25] "Validated CRI v1 image API" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.168921 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 22:08:48.570006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.172398 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8784a920-aef5-4512-9f90-2de3baaca4b8:/dev/nvme0n1p4 9e44e7be-b935-4631-8764-822979732c9a:/dev/nvme0n1p3] Jul 17 22:08:48.573175 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.172419 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 22:08:48.573630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.178799 2556 manager.go:216] Machine: {Timestamp:2026-07-17 22:08:48.177893323 +0000 UTC m=+0.336082018 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100203 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d5178076500ab0195f221e0fd45d SystemUUID:ec20d517-8076-500a-b019-5f221e0fd45d BootID:8bd0e6ec-63e5-4926-809f-432c49677b27 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a0:f5:79:95:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a0:f5:79:95:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:83:6f:12:72:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 22:08:48.573630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.178944 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 22:08:48.573630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.179060 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 22:08:48.573630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.181544 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 22:08:48.573630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.181587 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 22:08:48.573630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.182296 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 22:08:48.573630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.182305 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 22:08:48.573630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.182313 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.182341 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.183526 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.186417 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.186687 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.187304 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.187315 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.187344 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.187356 2556 kubelet.go:398] "Adding apiserver pod source" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.189882 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.195838 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.195854 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.201058 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.202934 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.202961 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206028 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206047 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206057 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206066 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206080 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206088 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206104 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206112 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206121 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206129 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206141 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206150 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206911 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.206920 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.208473 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.208466 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.210253 2556 server.go:1268] "Started kubelet" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.210468 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.210769 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.210773 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.211673 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.212913 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.212928 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.215680 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 22:08:48.575481 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.215669 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.218537 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.219015 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.219136 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.219581 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.219613 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.219631 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.219744 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.219755 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.219893 2556 factory.go:55] Registering systemd factory Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.219929 2556 factory.go:223] Registration of the systemd container factory successfully Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.220163 2556 factory.go:153] Registering CRI-O factory Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.220174 2556 factory.go:223] Registration of the crio container factory successfully Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.220224 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.220248 2556 factory.go:103] Registering Raw factory Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.220262 2556 manager.go:1196] Started watching for new ooms in manager Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.221018 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5n6zx" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.221115 2556 manager.go:349] Starting recovery of all containers Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.222086 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.222186 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.222280 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-78.ec2.internal.18c33328eb67e768 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-78.ec2.internal,UID:ip-10-0-142-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-78.ec2.internal,},FirstTimestamp:2026-07-17 22:08:48.210012008 +0000 UTC m=+0.368200703,LastTimestamp:2026-07-17 22:08:48.210012008 +0000 UTC m=+0.368200703,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-78.ec2.internal,}" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.228865 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5n6zx" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.239578 2556 manager.go:354] Recovery completed Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.244075 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.246040 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientMemory" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.246068 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.246078 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientPID" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.246633 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.246647 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.246666 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.246668 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.247632 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientMemory" Jul 17 22:08:48.577484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.247677 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.247692 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientPID" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.247810 2556 policy_none.go:49] "None policy: Start" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.247828 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.247842 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.248109 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-78.ec2.internal.18c33328ed8dd764 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-78.ec2.internal,UID:ip-10-0-142-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-78.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-78.ec2.internal,},FirstTimestamp:2026-07-17 22:08:48.246052708 +0000 UTC m=+0.404241403,LastTimestamp:2026-07-17 22:08:48.246052708 +0000 UTC m=+0.404241403,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-78.ec2.internal,}" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.250388 2556 policy_none.go:47] "Start" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.300904 2556 manager.go:337] "Starting Device Plugin manager" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.300934 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.300944 2556 server.go:87] "Starting device plugin registration server" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.301228 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.301239 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.301372 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.301453 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.301463 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.301906 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.301959 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.308312 2556 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2591 into the system container \"/system.slice\": " Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.402192 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.403166 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientMemory" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.403198 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.403215 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientPID" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.403249 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-78.ec2.internal" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:48.414757 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-78.ec2.internal" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.414900 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-78.ec2.internal\": node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.432839 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:48.580355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.533096 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:48.684664 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.633507 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:48.798985 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.734266 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:48.918230 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.834828 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:48.938181 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:48.935276 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:49.047493 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.035793 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:49.161077 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.118213 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 22:08:49.161077 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.136181 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:49.161077 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.141319 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 22:08:49.161077 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.141454 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.222146 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.223387 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.223423 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.223449 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.223491 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.225764 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.236298 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 22:03:48 +0000 UTC" deadline="2028-03-19 05:33:16.551376692 +0000 UTC" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.236310 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.236317 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14647h24m27.315062031s" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.323866 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal"] Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.323957 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.325902 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientMemory" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.325933 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.325945 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientPID" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327189 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327310 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327359 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327872 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientMemory" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327880 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientMemory" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327895 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327903 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327905 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientPID" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.327912 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientPID" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.329039 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.329060 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.329702 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientMemory" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.329719 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.329731 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeHasSufficientPID" Jul 17 22:08:49.347221 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.337384 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:49.468008 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.425058 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bc2a20e77f7595ccd462b1cae835411-config\") pod \"kube-apiserver-proxy-ip-10-0-142-78.ec2.internal\" (UID: \"8bc2a20e77f7595ccd462b1cae835411\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.468008 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.425096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ae521fb49591405044742393ea51e08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal\" (UID: \"5ae521fb49591405044742393ea51e08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.468008 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.425124 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae521fb49591405044742393ea51e08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal\" (UID: \"5ae521fb49591405044742393ea51e08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.468008 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.438159 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:49.585962 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.526264 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ae521fb49591405044742393ea51e08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal\" (UID: \"5ae521fb49591405044742393ea51e08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.585962 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.526301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae521fb49591405044742393ea51e08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal\" (UID: \"5ae521fb49591405044742393ea51e08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.585962 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.526347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5ae521fb49591405044742393ea51e08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal\" (UID: \"5ae521fb49591405044742393ea51e08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.585962 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.526384 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bc2a20e77f7595ccd462b1cae835411-config\") pod \"kube-apiserver-proxy-ip-10-0-142-78.ec2.internal\" (UID: \"8bc2a20e77f7595ccd462b1cae835411\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.585962 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.526419 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ae521fb49591405044742393ea51e08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal\" (UID: \"5ae521fb49591405044742393ea51e08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.585962 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.526352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bc2a20e77f7595ccd462b1cae835411-config\") pod \"kube-apiserver-proxy-ip-10-0-142-78.ec2.internal\" (UID: \"8bc2a20e77f7595ccd462b1cae835411\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.585962 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.527421 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 22:08:49.585962 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.539085 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:49.655443 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.639716 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-78.ec2.internal\" not found" Jul 17 22:08:49.661323 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.661304 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-78.ec2.internal\" not found" node="ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.663756 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.663740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.665924 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:49.665908 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-78.ec2.internal\" not found" node="ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.669236 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.669219 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.688947 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.688916 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 22:08:49.720343 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.720287 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.733367 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.733344 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 22:08:49.734227 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.734213 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" Jul 17 22:08:49.742950 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:49.742935 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 22:08:50.191318 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.191299 2556 apiserver.go:52] "Watching apiserver" Jul 17 22:08:50.198714 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.198692 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 22:08:50.199217 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.199186 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-kwz6x","openshift-network-operator/iptables-alerter-hfwq6","kube-system/konnectivity-agent-2n29f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal","openshift-multus/network-metrics-daemon-p7khv","openshift-network-diagnostics/network-check-target-gdhb8","openshift-ovn-kubernetes/ovnkube-node-cwcjd","kube-system/global-pull-secret-syncer-7wlr8","kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal","openshift-cluster-node-tuning-operator/tuned-s758p","openshift-dns/node-resolver-k2pss","openshift-image-registry/node-ca-4zdhk","openshift-multus/multus-additional-cni-plugins-nt4vl"] Jul 17 22:08:50.200720 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.200695 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:50.200871 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.200842 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:08:50.202127 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.202107 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.203308 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.203291 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:08:50.204647 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.204628 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qwsxr\"" Jul 17 22:08:50.204757 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.204647 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 22:08:50.204861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.204811 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:08:50.205063 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.205046 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.205700 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.205681 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 22:08:50.205816 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.205688 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7mv4l\"" Jul 17 22:08:50.205816 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.205774 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 22:08:50.206165 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.206149 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.207298 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.207282 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:50.207405 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.207373 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:08:50.207480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.207457 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 22:08:50.208120 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.208104 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 22:08:50.208224 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.208208 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f8z2k\"" Jul 17 22:08:50.208412 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.208398 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 22:08:50.208516 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.208402 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.208516 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.208490 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:08:50.208717 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.208702 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 22:08:50.208796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.208716 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 22:08:50.208851 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.208801 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6pms\"" Jul 17 22:08:50.208987 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.208973 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 22:08:50.209074 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.209010 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 22:08:50.209074 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.209070 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 22:08:50.209628 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.209613 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.210925 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.210907 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.212210 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.212190 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 22:08:50.212329 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.212230 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x9zq5\"" Jul 17 22:08:50.212329 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.212190 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 22:08:50.212329 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.212314 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.212603 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.212502 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 22:08:50.213558 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.213535 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 22:08:50.213643 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.213558 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:08:50.213643 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.213629 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 22:08:50.213799 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.213780 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.213870 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.213821 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m6dmt\"" Jul 17 22:08:50.216672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.215111 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.216672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.215237 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n7crw\"" Jul 17 22:08:50.216672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.216305 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 22:08:50.216672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.216391 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 22:08:50.216896 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.216869 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 22:08:50.218525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.217438 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 22:08:50.218525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.217523 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 22:08:50.218525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.217684 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 22:08:50.218525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.218243 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 22:08:50.218525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.218305 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 22:08:50.218525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.218245 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2985h\"" Jul 17 22:08:50.218525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.218399 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 22:08:50.218929 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.218913 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 22:08:50.219691 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.219670 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hps8m\"" Jul 17 22:08:50.221706 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.221686 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 22:08:50.230792 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lgm\" (UniqueName: \"kubernetes.io/projected/2ecafaba-a637-4223-9f95-1bef2dd6449b-kube-api-access-72lgm\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.230892 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230804 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-kubelet\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.230892 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230828 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s9qv\" (UniqueName: \"kubernetes.io/projected/26ca3f5f-aaba-4e34-ae88-97245f318cf4-kube-api-access-5s9qv\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.230892 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-sys-fs\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.230892 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230900 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a09ae06-4826-4805-93d2-c7cbbb06681b-cni-binary-copy\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230947 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0699427e-f6b2-4b1c-9794-fa48e23836d7-iptables-alerter-script\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230970 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0699427e-f6b2-4b1c-9794-fa48e23836d7-host-slash\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.230993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-log-socket\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231015 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-k8s-cni-cncf-io\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-tmp\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231062 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7906899-be0c-4a35-bfdb-2aff51baf928-dbus\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.231099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231093 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ca3f5f-aaba-4e34-ae88-97245f318cf4-tmp-dir\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-system-cni-dir\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v98wf\" (UniqueName: \"kubernetes.io/projected/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-kube-api-access-v98wf\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231179 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovnkube-config\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231209 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-netns\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-cni-multus\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-host\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bstx5\" (UniqueName: \"kubernetes.io/projected/cf84a885-43d8-484f-88f2-85f9a52866b4-kube-api-access-bstx5\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231392 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-cni-netd\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231406 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-system-cni-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231420 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-multus-certs\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-etc-kubernetes\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.231456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-tuned\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/884c3385-de1b-463b-b05f-26d5a7cd934f-konnectivity-ca\") pod \"konnectivity-agent-2n29f\" (UID: \"884c3385-de1b-463b-b05f-26d5a7cd934f\") " pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfp84\" (UniqueName: \"kubernetes.io/projected/9a09ae06-4826-4805-93d2-c7cbbb06681b-kube-api-access-kfp84\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/884c3385-de1b-463b-b05f-26d5a7cd934f-agent-certs\") pod \"konnectivity-agent-2n29f\" (UID: \"884c3385-de1b-463b-b05f-26d5a7cd934f\") " pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gch4c\" (UniqueName: \"kubernetes.io/projected/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-kube-api-access-gch4c\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231553 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cnibin\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231637 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231657 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231687 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysctl-d\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-lib-modules\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231755 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npn95\" (UniqueName: \"kubernetes.io/projected/0699427e-f6b2-4b1c-9794-fa48e23836d7-kube-api-access-npn95\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231777 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-kubelet\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.231965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovn-node-metrics-cert\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-daemon-config\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-systemd\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-serviceca\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231958 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-slash\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vwkq\" (UniqueName: \"kubernetes.io/projected/39c40759-5ff2-450f-8541-91ae0a4fa8b5-kube-api-access-5vwkq\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.231999 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-registration-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-systemd-units\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-var-lib-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-node-log\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232082 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-cni-bin\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-hostroot\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.232312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-run\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysconfig\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-os-release\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-env-overrides\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232211 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-cnibin\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-os-release\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-var-lib-kubelet\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-kubernetes\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232282 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysctl-conf\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-socket-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-run-netns\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-socket-dir-parent\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-conf-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.232823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26ca3f5f-aaba-4e34-ae88-97245f318cf4-hosts-file\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232486 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-cni-bin\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovnkube-script-lib\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232550 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-cni-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232582 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-modprobe-d\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232603 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-sys\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-etc-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-host\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78bmj\" (UniqueName: \"kubernetes.io/projected/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-kube-api-access-78bmj\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232701 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-systemd\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232726 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-ovn\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7906899-be0c-4a35-bfdb-2aff51baf928-kubelet-config\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-device-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.233291 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232813 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.233818 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.232838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.234262 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.234243 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 22:08:50.251855 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.251836 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p6nfn" Jul 17 22:08:50.259119 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.259099 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p6nfn" Jul 17 22:08:50.294489 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.294460 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae521fb49591405044742393ea51e08.slice/crio-24794a96c80cc03f6ed1fd25ad023cb425d39dbb5a3bb1cfe5e5cd477a63b0af WatchSource:0}: Error finding container 24794a96c80cc03f6ed1fd25ad023cb425d39dbb5a3bb1cfe5e5cd477a63b0af: Status 404 returned error can't find the container with id 24794a96c80cc03f6ed1fd25ad023cb425d39dbb5a3bb1cfe5e5cd477a63b0af Jul 17 22:08:50.294836 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.294819 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc2a20e77f7595ccd462b1cae835411.slice/crio-085f7427d249ae96a37bb7b64f06086cc5b8fde7e35d8a539908a6239842def2 WatchSource:0}: Error finding container 085f7427d249ae96a37bb7b64f06086cc5b8fde7e35d8a539908a6239842def2: Status 404 returned error can't find the container with id 085f7427d249ae96a37bb7b64f06086cc5b8fde7e35d8a539908a6239842def2 Jul 17 22:08:50.299444 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.299427 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 22:08:50.333353 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333316 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-systemd\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.333480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333357 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-serviceca\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.333480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.333480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333389 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-slash\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.333480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vwkq\" (UniqueName: \"kubernetes.io/projected/39c40759-5ff2-450f-8541-91ae0a4fa8b5-kube-api-access-5vwkq\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:50.333480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333445 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-systemd\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.333480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-registration-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333474 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-slash\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333528 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-registration-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-systemd-units\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-systemd-units\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-var-lib-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-node-log\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333619 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-cni-bin\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333642 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-hostroot\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-run\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333679 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-hostroot\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333682 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-cni-bin\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333642 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-node-log\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.333802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333800 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-serviceca\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.334281 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333836 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-run\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.334281 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334219 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.334281 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334233 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-var-lib-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.334408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.333698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.334408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334311 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysconfig\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.334408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-os-release\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.334408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-env-overrides\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.334408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-cnibin\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.334408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-os-release\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysconfig\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334437 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-os-release\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334452 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-cnibin\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334454 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-os-release\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-var-lib-kubelet\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334546 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-kubernetes\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334557 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-var-lib-kubelet\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysctl-conf\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334594 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-kubernetes\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-socket-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-run-netns\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.334672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-socket-dir-parent\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334688 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-conf-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334697 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-socket-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334701 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-run-netns\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334729 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysctl-conf\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334735 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-conf-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334734 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-socket-dir-parent\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26ca3f5f-aaba-4e34-ae88-97245f318cf4-hosts-file\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334803 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-cni-bin\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.334823 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovnkube-script-lib\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26ca3f5f-aaba-4e34-ae88-97245f318cf4-hosts-file\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334850 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-cni-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334859 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-cni-bin\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334858 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-env-overrides\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.334882 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs podName:39c40759-5ff2-450f-8541-91ae0a4fa8b5 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:50.834863492 +0000 UTC m=+2.993052190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs") pod "network-metrics-daemon-p7khv" (UID: "39c40759-5ff2-450f-8541-91ae0a4fa8b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-modprobe-d\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-sys\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334957 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-etc-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334970 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-sys\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-cni-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-modprobe-d\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.334980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-host\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335008 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-etc-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335022 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-host\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78bmj\" (UniqueName: \"kubernetes.io/projected/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-kube-api-access-78bmj\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-systemd\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335164 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-systemd\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.335854 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335493 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-ovn\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7906899-be0c-4a35-bfdb-2aff51baf928-kubelet-config\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335569 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-device-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335574 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-ovn\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335604 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335588 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovnkube-script-lib\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lgm\" (UniqueName: \"kubernetes.io/projected/2ecafaba-a637-4223-9f95-1bef2dd6449b-kube-api-access-72lgm\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335652 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7906899-be0c-4a35-bfdb-2aff51baf928-kubelet-config\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-kubelet\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335713 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-device-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335713 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s9qv\" (UniqueName: \"kubernetes.io/projected/26ca3f5f-aaba-4e34-ae88-97245f318cf4-kube-api-access-5s9qv\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335763 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-kubelet\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.336513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-sys-fs\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335810 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-sys-fs\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.335991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a09ae06-4826-4805-93d2-c7cbbb06681b-cni-binary-copy\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336070 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0699427e-f6b2-4b1c-9794-fa48e23836d7-iptables-alerter-script\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0699427e-f6b2-4b1c-9794-fa48e23836d7-host-slash\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-log-socket\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-k8s-cni-cncf-io\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336177 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-tmp\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336216 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7906899-be0c-4a35-bfdb-2aff51baf928-dbus\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336247 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ca3f5f-aaba-4e34-ae88-97245f318cf4-tmp-dir\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.337116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-system-cni-dir\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98wf\" (UniqueName: \"kubernetes.io/projected/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-kube-api-access-v98wf\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovnkube-config\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336384 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-netns\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-cni-multus\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-host\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bstx5\" (UniqueName: \"kubernetes.io/projected/cf84a885-43d8-484f-88f2-85f9a52866b4-kube-api-access-bstx5\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-cni-netd\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336541 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-system-cni-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-multus-certs\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-etc-kubernetes\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-tuned\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336618 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a09ae06-4826-4805-93d2-c7cbbb06681b-cni-binary-copy\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336643 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/884c3385-de1b-463b-b05f-26d5a7cd934f-konnectivity-ca\") pod \"konnectivity-agent-2n29f\" (UID: \"884c3385-de1b-463b-b05f-26d5a7cd934f\") " pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:08:50.337752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336672 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfp84\" (UniqueName: \"kubernetes.io/projected/9a09ae06-4826-4805-93d2-c7cbbb06681b-kube-api-access-kfp84\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/884c3385-de1b-463b-b05f-26d5a7cd934f-agent-certs\") pod \"konnectivity-agent-2n29f\" (UID: \"884c3385-de1b-463b-b05f-26d5a7cd934f\") " pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gch4c\" (UniqueName: \"kubernetes.io/projected/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-kube-api-access-gch4c\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336743 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0699427e-f6b2-4b1c-9794-fa48e23836d7-iptables-alerter-script\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cnibin\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336814 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336829 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-system-cni-dir\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336837 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336866 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysctl-d\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336882 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-netns\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-lib-modules\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npn95\" (UniqueName: \"kubernetes.io/projected/0699427e-f6b2-4b1c-9794-fa48e23836d7-kube-api-access-npn95\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336931 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-var-lib-cni-multus\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.338418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-kubelet\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336980 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-host\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.336990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337023 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovn-node-metrics-cert\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337052 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-daemon-config\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337054 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovnkube-config\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337146 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-k8s-cni-cncf-io\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337201 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-host-run-multus-certs\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337251 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a09ae06-4826-4805-93d2-c7cbbb06681b-etc-kubernetes\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.337365 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337363 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337565 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf84a885-43d8-484f-88f2-85f9a52866b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337673 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cnibin\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337776 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-sysctl-d\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337783 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/884c3385-de1b-463b-b05f-26d5a7cd934f-konnectivity-ca\") pod \"konnectivity-agent-2n29f\" (UID: \"884c3385-de1b-463b-b05f-26d5a7cd934f\") " pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:08:50.339048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337823 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.337834 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-log-socket\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338081 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338129 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-run-openvswitch\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338295 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a09ae06-4826-4805-93d2-c7cbbb06681b-multus-daemon-config\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338387 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ca3f5f-aaba-4e34-ae88-97245f318cf4-tmp-dir\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338472 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0699427e-f6b2-4b1c-9794-fa48e23836d7-host-slash\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.338537 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret podName:f7906899-be0c-4a35-bfdb-2aff51baf928 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:50.838514255 +0000 UTC m=+2.996702941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret") pod "global-pull-secret-syncer-7wlr8" (UID: "f7906899-be0c-4a35-bfdb-2aff51baf928") : object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338559 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-kubelet\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338593 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7906899-be0c-4a35-bfdb-2aff51baf928-dbus\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-system-cni-dir\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.338951 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-lib-modules\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.339737 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.339471 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ecafaba-a637-4223-9f95-1bef2dd6449b-host-cni-netd\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.342109 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.342089 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-etc-tuned\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.342195 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.342121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-tmp\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.342195 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.342141 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ecafaba-a637-4223-9f95-1bef2dd6449b-ovn-node-metrics-cert\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.342272 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.342239 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/884c3385-de1b-463b-b05f-26d5a7cd934f-agent-certs\") pod \"konnectivity-agent-2n29f\" (UID: \"884c3385-de1b-463b-b05f-26d5a7cd934f\") " pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:08:50.342585 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.342569 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vwkq\" (UniqueName: \"kubernetes.io/projected/39c40759-5ff2-450f-8541-91ae0a4fa8b5-kube-api-access-5vwkq\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:50.345253 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.345226 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lgm\" (UniqueName: \"kubernetes.io/projected/2ecafaba-a637-4223-9f95-1bef2dd6449b-kube-api-access-72lgm\") pod \"ovnkube-node-cwcjd\" (UID: \"2ecafaba-a637-4223-9f95-1bef2dd6449b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.345392 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.345372 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 22:08:50.345392 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.345393 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 22:08:50.345563 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.345406 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gqm4f for pod openshift-network-diagnostics/network-check-target-gdhb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:50.345563 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.345461 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78bmj\" (UniqueName: \"kubernetes.io/projected/1b518b3c-44c6-46f8-ac78-45e93d6ed3cc-kube-api-access-78bmj\") pod \"tuned-s758p\" (UID: \"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc\") " pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.345563 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.345470 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f podName:950dd0ed-0446-4c16-a439-6bb1f039ff57 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:50.845453836 +0000 UTC m=+3.003642521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gqm4f" (UniqueName: "kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f") pod "network-check-target-gdhb8" (UID: "950dd0ed-0446-4c16-a439-6bb1f039ff57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:50.345743 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.345606 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bstx5\" (UniqueName: \"kubernetes.io/projected/cf84a885-43d8-484f-88f2-85f9a52866b4-kube-api-access-bstx5\") pod \"aws-ebs-csi-driver-node-dzx9w\" (UID: \"cf84a885-43d8-484f-88f2-85f9a52866b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.345908 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.345882 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s9qv\" (UniqueName: \"kubernetes.io/projected/26ca3f5f-aaba-4e34-ae88-97245f318cf4-kube-api-access-5s9qv\") pod \"node-resolver-k2pss\" (UID: \"26ca3f5f-aaba-4e34-ae88-97245f318cf4\") " pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.346058 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.346043 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npn95\" (UniqueName: \"kubernetes.io/projected/0699427e-f6b2-4b1c-9794-fa48e23836d7-kube-api-access-npn95\") pod \"iptables-alerter-hfwq6\" (UID: \"0699427e-f6b2-4b1c-9794-fa48e23836d7\") " pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.346603 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.346588 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v98wf\" (UniqueName: \"kubernetes.io/projected/d76f636b-dc83-40aa-9bd3-62b7b7cfe85c-kube-api-access-v98wf\") pod \"multus-additional-cni-plugins-nt4vl\" (UID: \"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c\") " pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.347221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.347201 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfp84\" (UniqueName: \"kubernetes.io/projected/9a09ae06-4826-4805-93d2-c7cbbb06681b-kube-api-access-kfp84\") pod \"multus-kwz6x\" (UID: \"9a09ae06-4826-4805-93d2-c7cbbb06681b\") " pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.347493 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.347476 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gch4c\" (UniqueName: \"kubernetes.io/projected/0e9a1ee0-6b84-460c-97a9-7604811a6a6a-kube-api-access-gch4c\") pod \"node-ca-4zdhk\" (UID: \"0e9a1ee0-6b84-460c-97a9-7604811a6a6a\") " pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.521615 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.521530 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s758p" Jul 17 22:08:50.530295 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.530270 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b518b3c_44c6_46f8_ac78_45e93d6ed3cc.slice/crio-3bd8015346c7e0ccd22028018564b959422823c715e9e67f067a5c904aa4023c WatchSource:0}: Error finding container 3bd8015346c7e0ccd22028018564b959422823c715e9e67f067a5c904aa4023c: Status 404 returned error can't find the container with id 3bd8015346c7e0ccd22028018564b959422823c715e9e67f067a5c904aa4023c Jul 17 22:08:50.537487 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.537467 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfwq6" Jul 17 22:08:50.544453 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.544431 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0699427e_f6b2_4b1c_9794_fa48e23836d7.slice/crio-1bb7e7dc4c63583430e49214fb587654cc6bc2b713836cd21fdf3036f988e7e2 WatchSource:0}: Error finding container 1bb7e7dc4c63583430e49214fb587654cc6bc2b713836cd21fdf3036f988e7e2: Status 404 returned error can't find the container with id 1bb7e7dc4c63583430e49214fb587654cc6bc2b713836cd21fdf3036f988e7e2 Jul 17 22:08:50.555499 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.555481 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:08:50.562173 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.562151 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884c3385_de1b_463b_b05f_26d5a7cd934f.slice/crio-d9548f6651acc0adb993c7eaba1b8e566b3c23bf16eaf6cc963b15f8f4b823d0 WatchSource:0}: Error finding container d9548f6651acc0adb993c7eaba1b8e566b3c23bf16eaf6cc963b15f8f4b823d0: Status 404 returned error can't find the container with id d9548f6651acc0adb993c7eaba1b8e566b3c23bf16eaf6cc963b15f8f4b823d0 Jul 17 22:08:50.571159 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.571142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" Jul 17 22:08:50.577914 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.577885 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf84a885_43d8_484f_88f2_85f9a52866b4.slice/crio-ffb4ec8f4e6604f119b31db2d2d75300e1cd6691343008a2d2a25c684c9266af WatchSource:0}: Error finding container ffb4ec8f4e6604f119b31db2d2d75300e1cd6691343008a2d2a25c684c9266af: Status 404 returned error can't find the container with id ffb4ec8f4e6604f119b31db2d2d75300e1cd6691343008a2d2a25c684c9266af Jul 17 22:08:50.599422 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.599396 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" Jul 17 22:08:50.605305 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.605278 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4zdhk" Jul 17 22:08:50.606156 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.606135 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76f636b_dc83_40aa_9bd3_62b7b7cfe85c.slice/crio-daf4bc84225181cf74038a47e2622b95abe4603ddaaa59141849117a4e297774 WatchSource:0}: Error finding container daf4bc84225181cf74038a47e2622b95abe4603ddaaa59141849117a4e297774: Status 404 returned error can't find the container with id daf4bc84225181cf74038a47e2622b95abe4603ddaaa59141849117a4e297774 Jul 17 22:08:50.611662 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.611643 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:08:50.611843 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.611823 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9a1ee0_6b84_460c_97a9_7604811a6a6a.slice/crio-8f83c630c162ac1df449e003c784cfd99181bd3c9abbdd1ca32280dcd6a7fba9 WatchSource:0}: Error finding container 8f83c630c162ac1df449e003c784cfd99181bd3c9abbdd1ca32280dcd6a7fba9: Status 404 returned error can't find the container with id 8f83c630c162ac1df449e003c784cfd99181bd3c9abbdd1ca32280dcd6a7fba9 Jul 17 22:08:50.617161 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.617140 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kwz6x" Jul 17 22:08:50.618200 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.618183 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k2pss" Jul 17 22:08:50.618615 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.618598 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecafaba_a637_4223_9f95_1bef2dd6449b.slice/crio-309ac9cba2950726abeb3aafbb75201fd16098399ab1e1205c7ba35841f98e72 WatchSource:0}: Error finding container 309ac9cba2950726abeb3aafbb75201fd16098399ab1e1205c7ba35841f98e72: Status 404 returned error can't find the container with id 309ac9cba2950726abeb3aafbb75201fd16098399ab1e1205c7ba35841f98e72 Jul 17 22:08:50.624433 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.624410 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a09ae06_4826_4805_93d2_c7cbbb06681b.slice/crio-93b0a73f40b52d6b930441ca2ae397c705d409694a73c1c9269c395450cff236 WatchSource:0}: Error finding container 93b0a73f40b52d6b930441ca2ae397c705d409694a73c1c9269c395450cff236: Status 404 returned error can't find the container with id 93b0a73f40b52d6b930441ca2ae397c705d409694a73c1c9269c395450cff236 Jul 17 22:08:50.628136 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:08:50.628117 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ca3f5f_aaba_4e34_ae88_97245f318cf4.slice/crio-92f97eadc6315b513ed6be872c488d1dd40dacc655ad4f7be1dacf63b78b4b85 WatchSource:0}: Error finding container 92f97eadc6315b513ed6be872c488d1dd40dacc655ad4f7be1dacf63b78b4b85: Status 404 returned error can't find the container with id 92f97eadc6315b513ed6be872c488d1dd40dacc655ad4f7be1dacf63b78b4b85 Jul 17 22:08:50.841700 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.841617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:50.841866 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.841711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:50.841866 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.841843 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:50.841967 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.841909 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs podName:39c40759-5ff2-450f-8541-91ae0a4fa8b5 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:51.841889589 +0000 UTC m=+4.000078291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs") pod "network-metrics-daemon-p7khv" (UID: "39c40759-5ff2-450f-8541-91ae0a4fa8b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:50.842327 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.842303 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:50.842454 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.842375 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret podName:f7906899-be0c-4a35-bfdb-2aff51baf928 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:51.842360448 +0000 UTC m=+4.000549131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret") pod "global-pull-secret-syncer-7wlr8" (UID: "f7906899-be0c-4a35-bfdb-2aff51baf928") : object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:50.915679 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.915459 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 22:08:50.942120 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:50.942056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:50.942316 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.942227 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 22:08:50.942316 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.942250 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 22:08:50.942316 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.942263 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gqm4f for pod openshift-network-diagnostics/network-check-target-gdhb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:50.942482 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:50.942320 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f podName:950dd0ed-0446-4c16-a439-6bb1f039ff57 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:51.942301611 +0000 UTC m=+4.100490297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqm4f" (UniqueName: "kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f") pod "network-check-target-gdhb8" (UID: "950dd0ed-0446-4c16-a439-6bb1f039ff57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:51.249881 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.249772 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kwz6x" event={"ID":"9a09ae06-4826-4805-93d2-c7cbbb06681b","Type":"ContainerStarted","Data":"93b0a73f40b52d6b930441ca2ae397c705d409694a73c1c9269c395450cff236"} Jul 17 22:08:51.255896 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.255866 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"309ac9cba2950726abeb3aafbb75201fd16098399ab1e1205c7ba35841f98e72"} Jul 17 22:08:51.260627 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.260570 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 22:03:50 +0000 UTC" deadline="2028-01-11 13:43:46.587930425 +0000 UTC" Jul 17 22:08:51.260627 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.260606 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" event={"ID":"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c","Type":"ContainerStarted","Data":"daf4bc84225181cf74038a47e2622b95abe4603ddaaa59141849117a4e297774"} Jul 17 22:08:51.260778 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.260614 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13023h34m55.327320598s" Jul 17 22:08:51.264353 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.264216 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" event={"ID":"cf84a885-43d8-484f-88f2-85f9a52866b4","Type":"ContainerStarted","Data":"ffb4ec8f4e6604f119b31db2d2d75300e1cd6691343008a2d2a25c684c9266af"} Jul 17 22:08:51.266738 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.266691 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfwq6" event={"ID":"0699427e-f6b2-4b1c-9794-fa48e23836d7","Type":"ContainerStarted","Data":"1bb7e7dc4c63583430e49214fb587654cc6bc2b713836cd21fdf3036f988e7e2"} Jul 17 22:08:51.278068 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.278015 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" event={"ID":"5ae521fb49591405044742393ea51e08","Type":"ContainerStarted","Data":"24794a96c80cc03f6ed1fd25ad023cb425d39dbb5a3bb1cfe5e5cd477a63b0af"} Jul 17 22:08:51.279875 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.279826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" event={"ID":"8bc2a20e77f7595ccd462b1cae835411","Type":"ContainerStarted","Data":"085f7427d249ae96a37bb7b64f06086cc5b8fde7e35d8a539908a6239842def2"} Jul 17 22:08:51.284471 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.282579 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4zdhk" event={"ID":"0e9a1ee0-6b84-460c-97a9-7604811a6a6a","Type":"ContainerStarted","Data":"8f83c630c162ac1df449e003c784cfd99181bd3c9abbdd1ca32280dcd6a7fba9"} Jul 17 22:08:51.287649 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.287586 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2n29f" event={"ID":"884c3385-de1b-463b-b05f-26d5a7cd934f","Type":"ContainerStarted","Data":"d9548f6651acc0adb993c7eaba1b8e566b3c23bf16eaf6cc963b15f8f4b823d0"} Jul 17 22:08:51.289402 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.289343 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s758p" event={"ID":"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc","Type":"ContainerStarted","Data":"3bd8015346c7e0ccd22028018564b959422823c715e9e67f067a5c904aa4023c"} Jul 17 22:08:51.298531 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.298504 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k2pss" event={"ID":"26ca3f5f-aaba-4e34-ae88-97245f318cf4","Type":"ContainerStarted","Data":"92f97eadc6315b513ed6be872c488d1dd40dacc655ad4f7be1dacf63b78b4b85"} Jul 17 22:08:51.850279 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.850241 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:51.850477 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.850350 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:51.850477 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:51.850462 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:51.850588 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:51.850521 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs podName:39c40759-5ff2-450f-8541-91ae0a4fa8b5 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:53.85050349 +0000 UTC m=+6.008692186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs") pod "network-metrics-daemon-p7khv" (UID: "39c40759-5ff2-450f-8541-91ae0a4fa8b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:51.850949 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:51.850927 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:51.851047 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:51.850981 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret podName:f7906899-be0c-4a35-bfdb-2aff51baf928 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:53.850967655 +0000 UTC m=+6.009156336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret") pod "global-pull-secret-syncer-7wlr8" (UID: "f7906899-be0c-4a35-bfdb-2aff51baf928") : object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:51.951620 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:51.951576 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:51.951794 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:51.951741 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 22:08:51.951794 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:51.951762 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 22:08:51.951794 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:51.951774 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gqm4f for pod openshift-network-diagnostics/network-check-target-gdhb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:51.951946 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:51.951826 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f podName:950dd0ed-0446-4c16-a439-6bb1f039ff57 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:53.951808223 +0000 UTC m=+6.109996919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqm4f" (UniqueName: "kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f") pod "network-check-target-gdhb8" (UID: "950dd0ed-0446-4c16-a439-6bb1f039ff57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:52.223856 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:52.223769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:52.224024 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:52.223906 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:08:52.224252 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:52.224230 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:52.224325 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:52.224299 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:08:52.224434 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:52.224363 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:52.224495 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:52.224441 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:08:52.260916 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:52.260859 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 22:03:50 +0000 UTC" deadline="2028-02-23 18:13:21.527093374 +0000 UTC" Jul 17 22:08:52.260916 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:52.260911 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14060h4m29.266187541s" Jul 17 22:08:53.867789 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:53.867754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:53.868247 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:53.867854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:53.868247 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:53.867887 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:53.868247 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:53.867960 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret podName:f7906899-be0c-4a35-bfdb-2aff51baf928 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:57.867940105 +0000 UTC m=+10.026128802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret") pod "global-pull-secret-syncer-7wlr8" (UID: "f7906899-be0c-4a35-bfdb-2aff51baf928") : object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:53.868247 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:53.867977 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:53.868247 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:53.868041 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs podName:39c40759-5ff2-450f-8541-91ae0a4fa8b5 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:57.868025852 +0000 UTC m=+10.026214536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs") pod "network-metrics-daemon-p7khv" (UID: "39c40759-5ff2-450f-8541-91ae0a4fa8b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:53.969178 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:53.969142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:53.969374 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:53.969354 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 22:08:53.969447 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:53.969383 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 22:08:53.969447 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:53.969399 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gqm4f for pod openshift-network-diagnostics/network-check-target-gdhb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:53.969536 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:53.969495 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f podName:950dd0ed-0446-4c16-a439-6bb1f039ff57 nodeName:}" failed. No retries permitted until 2026-07-17 22:08:57.969477294 +0000 UTC m=+10.127665979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqm4f" (UniqueName: "kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f") pod "network-check-target-gdhb8" (UID: "950dd0ed-0446-4c16-a439-6bb1f039ff57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:54.225047 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:54.224581 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:54.225047 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:54.224800 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:08:54.225047 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:54.224946 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:54.225047 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:54.224966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:54.225350 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:54.225064 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:08:54.225350 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:54.225162 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:08:56.224544 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:56.224506 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:56.224544 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:56.224530 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:56.225040 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:56.224506 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:56.225040 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:56.224644 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:08:56.225040 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:56.224743 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:08:56.225040 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:56.224839 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:08:57.902614 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:57.902305 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:57.902614 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:57.902451 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:57.902614 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:57.902491 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:57.902614 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:57.902552 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:57.902614 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:57.902557 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret podName:f7906899-be0c-4a35-bfdb-2aff51baf928 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:05.902537997 +0000 UTC m=+18.060726702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret") pod "global-pull-secret-syncer-7wlr8" (UID: "f7906899-be0c-4a35-bfdb-2aff51baf928") : object "kube-system"/"original-pull-secret" not registered Jul 17 22:08:57.902614 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:57.902588 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs podName:39c40759-5ff2-450f-8541-91ae0a4fa8b5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:05.902577527 +0000 UTC m=+18.060766217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs") pod "network-metrics-daemon-p7khv" (UID: "39c40759-5ff2-450f-8541-91ae0a4fa8b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:08:58.002835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:58.002756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:58.002987 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:58.002969 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 22:08:58.003028 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:58.002989 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 22:08:58.003028 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:58.002999 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gqm4f for pod openshift-network-diagnostics/network-check-target-gdhb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:58.003085 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:58.003041 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f podName:950dd0ed-0446-4c16-a439-6bb1f039ff57 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:06.003029625 +0000 UTC m=+18.161218306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqm4f" (UniqueName: "kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f") pod "network-check-target-gdhb8" (UID: "950dd0ed-0446-4c16-a439-6bb1f039ff57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:08:58.224704 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:58.224560 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:08:58.224704 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:58.224607 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:08:58.224704 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:08:58.224672 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:08:58.224704 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:58.224690 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:08:58.224991 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:58.224787 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:08:58.224991 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:08:58.224879 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:00.224541 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:00.224504 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:00.224994 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:00.224641 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:00.225056 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:00.225026 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:00.225120 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:00.225045 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:00.225170 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:00.225146 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:00.225244 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:00.225224 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:02.223955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:02.223893 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:02.223955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:02.223923 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:02.224493 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:02.223893 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:02.224493 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:02.224014 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:02.224493 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:02.224153 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:02.224493 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:02.224249 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:04.224249 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:04.224214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:04.224683 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:04.224323 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:04.224683 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:04.224214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:04.224683 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:04.224431 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:04.224683 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:04.224214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:04.224683 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:04.224513 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:05.962324 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:05.962291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:05.962761 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:05.962348 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:05.962761 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:05.962447 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:09:05.962761 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:05.962468 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 22:09:05.962761 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:05.962522 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs podName:39c40759-5ff2-450f-8541-91ae0a4fa8b5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:21.962501229 +0000 UTC m=+34.120689912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs") pod "network-metrics-daemon-p7khv" (UID: "39c40759-5ff2-450f-8541-91ae0a4fa8b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:09:05.962761 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:05.962543 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret podName:f7906899-be0c-4a35-bfdb-2aff51baf928 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:21.962533007 +0000 UTC m=+34.120721691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret") pod "global-pull-secret-syncer-7wlr8" (UID: "f7906899-be0c-4a35-bfdb-2aff51baf928") : object "kube-system"/"original-pull-secret" not registered Jul 17 22:09:06.063676 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:06.063644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:06.063842 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:06.063757 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 22:09:06.063842 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:06.063780 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 22:09:06.063842 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:06.063792 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gqm4f for pod openshift-network-diagnostics/network-check-target-gdhb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:09:06.063948 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:06.063852 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f podName:950dd0ed-0446-4c16-a439-6bb1f039ff57 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:22.063834377 +0000 UTC m=+34.222023068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqm4f" (UniqueName: "kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f") pod "network-check-target-gdhb8" (UID: "950dd0ed-0446-4c16-a439-6bb1f039ff57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:09:06.223713 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:06.223629 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:06.223874 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:06.223629 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:06.223874 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:06.223748 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:06.223874 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:06.223839 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:06.223874 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:06.223647 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:06.224053 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:06.223926 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:08.224072 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:08.224038 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:08.224506 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:08.224039 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:08.224506 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:08.224174 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:08.224506 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:08.224150 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:08.224506 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:08.224255 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:08.224506 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:08.224315 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:10.224104 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.223926 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:10.224552 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.223941 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:10.224552 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:10.224187 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:10.224552 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.223975 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:10.224552 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:10.224242 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:10.224552 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:10.224312 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:10.339128 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.339101 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4zdhk" event={"ID":"0e9a1ee0-6b84-460c-97a9-7604811a6a6a","Type":"ContainerStarted","Data":"2d2811ff50f324548204e39e454150953345e780b830d3b91c92f648c56e8228"} Jul 17 22:09:10.340590 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.340564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2n29f" event={"ID":"884c3385-de1b-463b-b05f-26d5a7cd934f","Type":"ContainerStarted","Data":"1d84191b8890e0b0409211d6e52de374da9757cc62c336d391bd42e74cbe7fbf"} Jul 17 22:09:10.341802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.341778 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s758p" event={"ID":"1b518b3c-44c6-46f8-ac78-45e93d6ed3cc","Type":"ContainerStarted","Data":"1e5f53060bf3f451c792b0ea56dcb2654ba87781b2340b8dfe6feb400970e696"} Jul 17 22:09:10.343169 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.343147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k2pss" event={"ID":"26ca3f5f-aaba-4e34-ae88-97245f318cf4","Type":"ContainerStarted","Data":"5c51a1f8ff0675c99fe56ef89d32909f71ccdba4c1ce1032e1cb7ddaa7d4d651"} Jul 17 22:09:10.344429 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.344407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kwz6x" event={"ID":"9a09ae06-4826-4805-93d2-c7cbbb06681b","Type":"ContainerStarted","Data":"c5dd35a74fb452b1b3528ceb5bf9e1907cfea937d3c3ceb5b5c2095bc94fd8f0"} Jul 17 22:09:10.346317 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.346290 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"46db973a43058abb35fd42fb9022a8dc9bd8c044cbfd359350ec91f098ae2369"} Jul 17 22:09:10.346425 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.346392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"3bb1699e90068e2fb8016ad531ad7be67cd1d8aac4884cf9cf9f1e26143c176b"} Jul 17 22:09:10.346470 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.346447 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"d4d47e2cdac469c0ec46d9f848b78343623226ed5e8cb75fc753f8b6c2850c14"} Jul 17 22:09:10.347653 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.347634 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76f636b-dc83-40aa-9bd3-62b7b7cfe85c" containerID="67582f33624cd1c5117def3beefae5089e2a7afc943e224097ce01b45ebfec26" exitCode=0 Jul 17 22:09:10.347729 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.347693 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" event={"ID":"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c","Type":"ContainerDied","Data":"67582f33624cd1c5117def3beefae5089e2a7afc943e224097ce01b45ebfec26"} Jul 17 22:09:10.349062 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.349040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" event={"ID":"cf84a885-43d8-484f-88f2-85f9a52866b4","Type":"ContainerStarted","Data":"4262f29e4d02ffef84e897ab64a5d3462813cd77e3224aa7412e38e3a513bfcf"} Jul 17 22:09:10.350512 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.350492 2556 generic.go:356] "Generic (PLEG): container finished" podID="5ae521fb49591405044742393ea51e08" containerID="76d610c4213eb1c04ed6b4f6f9167f6501642fe70668debbfa3f5fd485a3a30a" exitCode=0 Jul 17 22:09:10.350578 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.350558 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" event={"ID":"5ae521fb49591405044742393ea51e08","Type":"ContainerDied","Data":"76d610c4213eb1c04ed6b4f6f9167f6501642fe70668debbfa3f5fd485a3a30a"} Jul 17 22:09:10.351964 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.351947 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" event={"ID":"8bc2a20e77f7595ccd462b1cae835411","Type":"ContainerStarted","Data":"365f8b2f084a2c323e59d527047d5a2fa54805e3eafda79c5f50b1157f490441"} Jul 17 22:09:10.357692 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.357657 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4zdhk" podStartSLOduration=3.419190694 podStartE2EDuration="22.357646637s" totalImagesPullingTime="18.938455943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:10.357463497 +0000 UTC m=+22.515652209" watchObservedRunningTime="2026-07-17 22:09:10.357646637 +0000 UTC m=+22.515835341" Jul 17 22:09:10.371533 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.371497 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-78.ec2.internal" podStartSLOduration=21.371472063 podStartE2EDuration="21.371472063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:10.371100577 +0000 UTC m=+22.529289277" watchObservedRunningTime="2026-07-17 22:09:10.371472063 +0000 UTC m=+22.529660767" Jul 17 22:09:10.388044 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.388009 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s758p" podStartSLOduration=3.365961365 podStartE2EDuration="22.387997499s" totalImagesPullingTime="19.022036134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:10.387950147 +0000 UTC m=+22.546138849" watchObservedRunningTime="2026-07-17 22:09:10.387997499 +0000 UTC m=+22.546186201" Jul 17 22:09:10.403212 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.403159 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2n29f" podStartSLOduration=3.413867968 podStartE2EDuration="22.403141587s" totalImagesPullingTime="18.989273619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:10.402763354 +0000 UTC m=+22.560952059" watchObservedRunningTime="2026-07-17 22:09:10.403141587 +0000 UTC m=+22.561330292" Jul 17 22:09:10.445062 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.444807 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kwz6x" podStartSLOduration=3.091004604 podStartE2EDuration="22.444785887s" totalImagesPullingTime="19.353781283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:10.444318661 +0000 UTC m=+22.602507363" watchObservedRunningTime="2026-07-17 22:09:10.444785887 +0000 UTC m=+22.602974591" Jul 17 22:09:10.477613 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.477575 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k2pss" podStartSLOduration=3.55498362 podStartE2EDuration="22.47754109s" totalImagesPullingTime="18.92255747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:10.477146015 +0000 UTC m=+22.635334719" watchObservedRunningTime="2026-07-17 22:09:10.47754109 +0000 UTC m=+22.635729792" Jul 17 22:09:10.604308 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.604284 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:09:10.604796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:10.604780 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:09:11.358170 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.358132 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"6cc822ad82e651a1187c39407b46e8966ac1f77b73265ab5dd9e8f92a90f90bf"} Jul 17 22:09:11.358624 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.358232 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"a44e7ee6da8b2b9272cb1bd180fe02ac5d9b36df96ad32344568eabb459ea9e8"} Jul 17 22:09:11.358624 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.358286 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"3bd33e156d410045673329941c49d4bfe8e07485fe2a6cde84f33ec33dc899f4"} Jul 17 22:09:11.359714 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.359685 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfwq6" event={"ID":"0699427e-f6b2-4b1c-9794-fa48e23836d7","Type":"ContainerStarted","Data":"2d3dfc25bff9b9720885a91cf990597c426327afebaddfa068a07801ee075a00"} Jul 17 22:09:11.361752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.361722 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" event={"ID":"5ae521fb49591405044742393ea51e08","Type":"ContainerStarted","Data":"57ea09ba70c523f07a6356840776a332078b82628c3f7a49e1c6a9f535cc9601"} Jul 17 22:09:11.361872 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.361797 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:09:11.362813 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.362784 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2n29f" Jul 17 22:09:11.374483 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.374435 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hfwq6" podStartSLOduration=4.368955616 podStartE2EDuration="23.374387513s" totalImagesPullingTime="19.005431897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:11.374295423 +0000 UTC m=+23.532484127" watchObservedRunningTime="2026-07-17 22:09:11.374387513 +0000 UTC m=+23.532576218" Jul 17 22:09:11.392224 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.392177 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-78.ec2.internal" podStartSLOduration=22.392164537 podStartE2EDuration="22.392164537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:11.391870585 +0000 UTC m=+23.550059306" watchObservedRunningTime="2026-07-17 22:09:11.392164537 +0000 UTC m=+23.550353240" Jul 17 22:09:11.657817 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:11.657785 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 22:09:12.223738 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:12.223711 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:12.224106 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:12.223749 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:12.224106 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:12.223749 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:12.224106 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:12.223821 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:12.224106 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:12.223938 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:12.224106 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:12.224018 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:12.315187 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:12.315051 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T22:09:11.657806228Z","UUID":"0c5a55f8-9c3f-4d3f-a765-36a23037a461","Handler":null,"Name":"","Endpoint":""} Jul 17 22:09:12.316942 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:12.316911 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 22:09:12.317071 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:12.316957 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 22:09:12.366096 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:12.366055 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" event={"ID":"cf84a885-43d8-484f-88f2-85f9a52866b4","Type":"ContainerStarted","Data":"4c6e84d4bb77a9b749dfeda6e1ade47cb16e24c2bf766b336c2b3a49840c2921"} Jul 17 22:09:13.370674 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:13.370576 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"9d977ee43d0accef99db81e2e29f85754ca8fd27939bcf688cd583ce428a4ff5"} Jul 17 22:09:13.372483 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:13.372455 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" event={"ID":"cf84a885-43d8-484f-88f2-85f9a52866b4","Type":"ContainerStarted","Data":"fff122759e018beac0ccf6be68495b47797b754c6884c91986443463789f225a"} Jul 17 22:09:13.390266 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:13.390230 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzx9w" podStartSLOduration=3.713649282 podStartE2EDuration="25.390217358s" totalImagesPullingTime="21.676568076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:13.389993517 +0000 UTC m=+25.548182220" watchObservedRunningTime="2026-07-17 22:09:13.390217358 +0000 UTC m=+25.548406061" Jul 17 22:09:14.223958 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:14.223918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:14.223958 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:14.223949 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:14.224191 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:14.224041 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:14.224191 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:14.224046 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:14.224191 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:14.224134 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:14.224315 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:14.224210 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:15.381424 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:15.381140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" event={"ID":"2ecafaba-a637-4223-9f95-1bef2dd6449b","Type":"ContainerStarted","Data":"35d02ef57a6a84caba48ec836173866a1819c074491a2ccb18f46d793ae1291c"} Jul 17 22:09:15.381889 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:15.381491 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:09:15.381889 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:15.381552 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:09:15.381889 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:15.381602 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:09:15.401761 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:15.401352 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:09:15.401761 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:15.401600 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:09:15.410650 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:15.410581 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" podStartSLOduration=8.187544951 podStartE2EDuration="27.410562583s" totalImagesPullingTime="19.223017632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:15.409939422 +0000 UTC m=+27.568128152" watchObservedRunningTime="2026-07-17 22:09:15.410562583 +0000 UTC m=+27.568751290" Jul 17 22:09:16.224408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:16.224374 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:16.224588 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:16.224493 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:16.224588 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:16.224387 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:16.224588 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:16.224582 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:16.224715 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:16.224488 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:16.224715 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:16.224660 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:16.385140 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:16.385104 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76f636b-dc83-40aa-9bd3-62b7b7cfe85c" containerID="cae4e5685d619790e66b043d75494bf078175921fa078dfd689ff8ffc1b8af5d" exitCode=0 Jul 17 22:09:16.385920 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:16.385152 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" event={"ID":"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c","Type":"ContainerDied","Data":"cae4e5685d619790e66b043d75494bf078175921fa078dfd689ff8ffc1b8af5d"} Jul 17 22:09:17.389183 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:17.389007 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76f636b-dc83-40aa-9bd3-62b7b7cfe85c" containerID="470a3c21bb7545c85ad937c55295ebe410fe143f481f50cf833acf3cad04560c" exitCode=0 Jul 17 22:09:17.389606 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:17.389087 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" event={"ID":"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c","Type":"ContainerDied","Data":"470a3c21bb7545c85ad937c55295ebe410fe143f481f50cf833acf3cad04560c"} Jul 17 22:09:17.516292 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:17.516219 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdhb8"] Jul 17 22:09:17.516436 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:17.516326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:17.516436 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:17.516416 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:17.518764 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:17.518734 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p7khv"] Jul 17 22:09:17.519164 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:17.518856 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:17.519164 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:17.518958 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:17.519472 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:17.519450 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7wlr8"] Jul 17 22:09:17.519564 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:17.519547 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:17.519666 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:17.519644 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:19.225749 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:19.225713 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:19.226197 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:19.225818 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:19.226197 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:19.225873 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:19.226197 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:19.225884 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:19.226197 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:19.225964 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:19.226197 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:19.226033 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:19.396576 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:19.396548 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76f636b-dc83-40aa-9bd3-62b7b7cfe85c" containerID="4f9e3cce7b25337f6db83fd43ddc3755ea35dc2addfc99cd3bbebec85d62e08d" exitCode=0 Jul 17 22:09:19.396698 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:19.396597 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" event={"ID":"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c","Type":"ContainerDied","Data":"4f9e3cce7b25337f6db83fd43ddc3755ea35dc2addfc99cd3bbebec85d62e08d"} Jul 17 22:09:21.224544 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:21.224505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:21.225024 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:21.224504 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:21.225024 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:21.224665 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:21.225024 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:21.224504 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:21.225024 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:21.224720 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:21.225024 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:21.224811 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:21.984011 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:21.983970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:21.984201 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:21.984062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:21.984201 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:21.984137 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 22:09:21.984201 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:21.984157 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:09:21.984370 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:21.984209 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs podName:39c40759-5ff2-450f-8541-91ae0a4fa8b5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:53.984190273 +0000 UTC m=+66.142378957 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs") pod "network-metrics-daemon-p7khv" (UID: "39c40759-5ff2-450f-8541-91ae0a4fa8b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 22:09:21.984370 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:21.984225 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret podName:f7906899-be0c-4a35-bfdb-2aff51baf928 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:53.984218766 +0000 UTC m=+66.142407448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret") pod "global-pull-secret-syncer-7wlr8" (UID: "f7906899-be0c-4a35-bfdb-2aff51baf928") : object "kube-system"/"original-pull-secret" not registered Jul 17 22:09:22.085283 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:22.085242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:22.085462 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:22.085425 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 22:09:22.085544 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:22.085478 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 22:09:22.085544 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:22.085492 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gqm4f for pod openshift-network-diagnostics/network-check-target-gdhb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:09:22.085648 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:22.085570 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f podName:950dd0ed-0446-4c16-a439-6bb1f039ff57 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:54.085551991 +0000 UTC m=+66.243740675 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqm4f" (UniqueName: "kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f") pod "network-check-target-gdhb8" (UID: "950dd0ed-0446-4c16-a439-6bb1f039ff57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 22:09:23.223730 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.223679 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:23.224187 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.223792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:23.224187 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.223806 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhb8" podUID="950dd0ed-0446-4c16-a439-6bb1f039ff57" Jul 17 22:09:23.224187 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.223828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:23.224187 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.223937 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7khv" podUID="39c40759-5ff2-450f-8541-91ae0a4fa8b5" Jul 17 22:09:23.224187 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.224003 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wlr8" podUID="f7906899-be0c-4a35-bfdb-2aff51baf928" Jul 17 22:09:23.615025 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.614953 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-78.ec2.internal" event="NodeReady" Jul 17 22:09:23.615172 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.615087 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 22:09:23.652391 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.652366 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64fd77f47d-9w6vw"] Jul 17 22:09:23.673160 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.673128 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f8988cdf5-npmb7"] Jul 17 22:09:23.673305 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.673249 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.676544 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.676267 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 22:09:23.676873 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.676851 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 22:09:23.676966 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.676904 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.678066 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.678048 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 22:09:23.678199 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.678055 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.678428 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.678247 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rdp6m\"" Jul 17 22:09:23.679281 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.679262 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 22:09:23.699813 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.699679 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m"] Jul 17 22:09:23.700013 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.699845 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.706284 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.706253 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcqbk\"" Jul 17 22:09:23.706447 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.706367 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 22:09:23.706664 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.706645 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 22:09:23.706850 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.706735 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 22:09:23.711944 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.711922 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 22:09:23.721695 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.721678 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn"] Jul 17 22:09:23.721812 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.721797 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m" Jul 17 22:09:23.724488 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.724471 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-566fv\"" Jul 17 22:09:23.724946 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.724932 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.724995 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.724935 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.747949 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.747928 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl"] Jul 17 22:09:23.748066 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.748048 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:23.750767 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.750749 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ngrdd\"" Jul 17 22:09:23.751087 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.751068 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 22:09:23.751169 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.751069 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.751169 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.751074 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 22:09:23.751249 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.751105 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.768230 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.768091 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-qdjzw"] Jul 17 22:09:23.768230 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.768219 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:23.770939 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.770917 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 22:09:23.771046 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.771008 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.771304 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.771284 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.771415 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.771284 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-742ss\"" Jul 17 22:09:23.790371 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.790343 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5"] Jul 17 22:09:23.790968 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.790950 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:23.794044 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.794018 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jblz7\"" Jul 17 22:09:23.794171 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.794069 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 22:09:23.794171 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.794078 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 22:09:23.794276 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.794170 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.794276 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.794173 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.797007 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.796986 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-trusted-ca\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.797117 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797012 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.797117 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.797117 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2kqd\" (UniqueName: \"kubernetes.io/projected/d2a59372-e2fc-4941-8504-f5c3ae176332-kube-api-access-q2kqd\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.797117 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-stats-auth\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.797360 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-ca-trust-extracted\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.797360 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-certificates\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.797360 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-image-registry-private-configuration\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.797360 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-installation-pull-secrets\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.797360 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.797972 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797946 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-default-certificate\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.798078 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.797993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-bound-sa-token\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.798078 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.798055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnzzt\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-kube-api-access-rnzzt\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.799486 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.799466 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 22:09:23.809936 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.809910 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:23.814642 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.814619 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-t4vf2"] Jul 17 22:09:23.814754 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.814740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:23.817668 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.817649 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 22:09:23.817768 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.817691 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.817768 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.817752 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.818189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.818172 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 22:09:23.818276 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.818228 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qsf44\"" Jul 17 22:09:23.838593 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.838562 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc"] Jul 17 22:09:23.838721 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.838678 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:23.841977 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.841956 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.842087 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.841977 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 22:09:23.842187 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.842168 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 22:09:23.842226 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.842208 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.842360 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.842322 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jnv6c\"" Jul 17 22:09:23.847678 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.847658 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 22:09:23.859020 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.858998 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m"] Jul 17 22:09:23.859110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.859035 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn"] Jul 17 22:09:23.859110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.859056 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5"] Jul 17 22:09:23.859110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.859073 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-t4vf2"] Jul 17 22:09:23.859110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.859090 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc"] Jul 17 22:09:23.859110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.859096 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:23.859110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.859109 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tdl2l"] Jul 17 22:09:23.861764 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.861750 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 22:09:23.861860 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.861796 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.861982 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.861962 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 22:09:23.862091 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.861994 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.862091 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.861962 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vmlt5\"" Jul 17 22:09:23.875095 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.875074 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-46h6v"] Jul 17 22:09:23.875210 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.875192 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tdl2l" Jul 17 22:09:23.877689 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.877668 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.877819 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.877806 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lx88d\"" Jul 17 22:09:23.877887 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.877846 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.878166 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.878148 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 22:09:23.889059 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.889031 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64fd77f47d-9w6vw"] Jul 17 22:09:23.889138 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.889069 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg"] Jul 17 22:09:23.889175 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.889139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:23.891647 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.891628 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 22:09:23.891877 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.891861 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 22:09:23.891946 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.891874 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2w95\"" Jul 17 22:09:23.892764 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.892745 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:23.899068 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-trusted-ca\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.899154 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.899154 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899098 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.899154 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899119 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2kqd\" (UniqueName: \"kubernetes.io/projected/d2a59372-e2fc-4941-8504-f5c3ae176332-kube-api-access-q2kqd\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.899154 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:23.899154 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d083fe3-08ed-469c-beb3-31f10c742433-config\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d083fe3-08ed-469c-beb3-31f10c742433-trusted-ca\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.899211 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.899225 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8988cdf5-npmb7: secret "image-registry-tls" not found Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.899247 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:24.399227655 +0000 UTC m=+36.557416352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : configmap references non-existent config key: service-ca.crt Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899215 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/115aa6f9-ed4e-4851-85c4-295a61a232ff-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.899271 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls podName:c08f5b67-bb9a-4585-b4d7-ffe841ce6826 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:24.399260988 +0000 UTC m=+36.557449673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls") pod "image-registry-6f8988cdf5-npmb7" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826") : secret "image-registry-tls" not found Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899306 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4hbj\" (UniqueName: \"kubernetes.io/projected/115aa6f9-ed4e-4851-85c4-295a61a232ff-kube-api-access-d4hbj\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899385 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-stats-auth\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.899448 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stp88\" (UniqueName: \"kubernetes.io/projected/8e4b1a65-ce08-4206-938a-7fa003385ce1-kube-api-access-stp88\") pod \"volume-data-source-validator-78cf4c6f6-g7d5m\" (UID: \"8e4b1a65-ce08-4206-938a-7fa003385ce1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899461 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-ca-trust-extracted\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-certificates\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899511 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-config\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899540 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-image-registry-private-configuration\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-installation-pull-secrets\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d083fe3-08ed-469c-beb3-31f10c742433-serving-cert\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-454pw\" (UniqueName: \"kubernetes.io/projected/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-kube-api-access-454pw\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-default-certificate\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kn75\" (UniqueName: \"kubernetes.io/projected/d354a993-b883-425a-9244-606c818ea254-kube-api-access-4kn75\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbwq\" (UniqueName: \"kubernetes.io/projected/0d083fe3-08ed-469c-beb3-31f10c742433-kube-api-access-rpbwq\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-bound-sa-token\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.899955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899821 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzzt\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-kube-api-access-rnzzt\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.900491 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-ca-trust-extracted\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.900491 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.899928 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 22:09:23.900491 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:23.899974 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:24.399958084 +0000 UTC m=+36.558146988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : secret "router-metrics-certs-default" not found Jul 17 22:09:23.900491 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.899997 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-certificates\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.900491 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.900295 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-trusted-ca\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.903311 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903285 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f8988cdf5-npmb7"] Jul 17 22:09:23.903409 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903348 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl"] Jul 17 22:09:23.903409 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903380 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tdl2l"] Jul 17 22:09:23.903409 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903404 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-qdjzw"] Jul 17 22:09:23.903499 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903427 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg"] Jul 17 22:09:23.903499 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903448 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-46h6v"] Jul 17 22:09:23.903550 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903508 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-default-certificate\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.903550 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-installation-pull-secrets\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.903613 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-image-registry-private-configuration\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.903613 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903583 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-stats-auth\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.903613 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.903592 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg" Jul 17 22:09:23.906629 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.906609 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 22:09:23.906739 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.906721 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 22:09:23.906785 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.906743 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hctw5\"" Jul 17 22:09:23.910602 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.910582 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2kqd\" (UniqueName: \"kubernetes.io/projected/d2a59372-e2fc-4941-8504-f5c3ae176332-kube-api-access-q2kqd\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:23.911053 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.911035 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnzzt\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-kube-api-access-rnzzt\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:23.911090 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:23.911043 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-bound-sa-token\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:24.000577 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000537 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48da6edc-ec29-45af-b684-f3ae08d9d1e0-cert\") pod \"ingress-canary-tdl2l\" (UID: \"48da6edc-ec29-45af-b684-f3ae08d9d1e0\") " pod="openshift-ingress-canary/ingress-canary-tdl2l" Jul 17 22:09:24.000577 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-snapshots\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.000782 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000594 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d86bd4a-ec07-4798-aaed-7608028ee9d5-tmp-dir\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.000782 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-service-ca-bundle\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.000782 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000674 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njbqz\" (UniqueName: \"kubernetes.io/projected/48da6edc-ec29-45af-b684-f3ae08d9d1e0-kube-api-access-njbqz\") pod \"ingress-canary-tdl2l\" (UID: \"48da6edc-ec29-45af-b684-f3ae08d9d1e0\") " pod="openshift-ingress-canary/ingress-canary-tdl2l" Jul 17 22:09:24.000782 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000741 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-454pw\" (UniqueName: \"kubernetes.io/projected/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-kube-api-access-454pw\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:24.000782 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000768 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-tmp\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.000924 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000897 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbwq\" (UniqueName: \"kubernetes.io/projected/0d083fe3-08ed-469c-beb3-31f10c742433-kube-api-access-rpbwq\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.000959 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.000992 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4hbj\" (UniqueName: \"kubernetes.io/projected/115aa6f9-ed4e-4851-85c4-295a61a232ff-kube-api-access-d4hbj\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:24.001032 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.000996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d083fe3-08ed-469c-beb3-31f10c742433-trusted-ca\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.001081 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001029 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d083fe3-08ed-469c-beb3-31f10c742433-config\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.001081 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001060 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brd2g\" (UniqueName: \"kubernetes.io/projected/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-kube-api-access-brd2g\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.001160 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.001160 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkzq\" (UniqueName: \"kubernetes.io/projected/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-kube-api-access-phkzq\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.001257 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-serving-cert\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.001310 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stp88\" (UniqueName: \"kubernetes.io/projected/8e4b1a65-ce08-4206-938a-7fa003385ce1-kube-api-access-stp88\") pod \"volume-data-source-validator-78cf4c6f6-g7d5m\" (UID: \"8e4b1a65-ce08-4206-938a-7fa003385ce1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m" Jul 17 22:09:24.001373 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001326 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq69g\" (UniqueName: \"kubernetes.io/projected/8d86bd4a-ec07-4798-aaed-7608028ee9d5-kube-api-access-wq69g\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.001423 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001374 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d083fe3-08ed-469c-beb3-31f10c742433-serving-cert\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.001484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kn75\" (UniqueName: \"kubernetes.io/projected/d354a993-b883-425a-9244-606c818ea254-kube-api-access-4kn75\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:24.001484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001468 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.001601 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/115aa6f9-ed4e-4851-85c4-295a61a232ff-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:24.001601 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:24.001601 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001572 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.001601 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-config\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:24.001801 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:24.001801 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:24.001801 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001696 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d86bd4a-ec07-4798-aaed-7608028ee9d5-config-volume\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.001801 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5wvw\" (UniqueName: \"kubernetes.io/projected/55ef691e-7927-4948-ad6c-e354a4b72add-kube-api-access-f5wvw\") pod \"network-check-source-7bc5b6bf85-cw2sg\" (UID: \"55ef691e-7927-4948-ad6c-e354a4b72add\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg" Jul 17 22:09:24.001979 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.001809 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d083fe3-08ed-469c-beb3-31f10c742433-config\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.001979 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.001856 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:24.001979 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.001874 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 22:09:24.001979 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.001924 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls podName:115aa6f9-ed4e-4851-85c4-295a61a232ff nodeName:}" failed. No retries permitted until 2026-07-17 22:09:24.501906307 +0000 UTC m=+36.660095003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8mjr5" (UID: "115aa6f9-ed4e-4851-85c4-295a61a232ff") : secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:24.001979 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.001942 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls podName:d354a993-b883-425a-9244-606c818ea254 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:24.501933101 +0000 UTC m=+36.660121790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kp5fl" (UID: "d354a993-b883-425a-9244-606c818ea254") : secret "samples-operator-tls" not found Jul 17 22:09:24.002222 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.002008 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d083fe3-08ed-469c-beb3-31f10c742433-trusted-ca\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.002222 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.002184 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/115aa6f9-ed4e-4851-85c4-295a61a232ff-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:24.002281 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.002225 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-config\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:24.003776 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.003757 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d083fe3-08ed-469c-beb3-31f10c742433-serving-cert\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.003871 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.003787 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:24.009352 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.009305 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-454pw\" (UniqueName: \"kubernetes.io/projected/9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6-kube-api-access-454pw\") pod \"service-ca-operator-5bcbc94c78-ttzsn\" (UID: \"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:24.010681 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.010654 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kn75\" (UniqueName: \"kubernetes.io/projected/d354a993-b883-425a-9244-606c818ea254-kube-api-access-4kn75\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:24.010785 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.010716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4hbj\" (UniqueName: \"kubernetes.io/projected/115aa6f9-ed4e-4851-85c4-295a61a232ff-kube-api-access-d4hbj\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:24.010853 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.010832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stp88\" (UniqueName: \"kubernetes.io/projected/8e4b1a65-ce08-4206-938a-7fa003385ce1-kube-api-access-stp88\") pod \"volume-data-source-validator-78cf4c6f6-g7d5m\" (UID: \"8e4b1a65-ce08-4206-938a-7fa003385ce1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m" Jul 17 22:09:24.010908 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.010887 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbwq\" (UniqueName: \"kubernetes.io/projected/0d083fe3-08ed-469c-beb3-31f10c742433-kube-api-access-rpbwq\") pod \"console-operator-565b7b569d-qdjzw\" (UID: \"0d083fe3-08ed-469c-beb3-31f10c742433\") " pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.040066 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.040026 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m" Jul 17 22:09:24.057071 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.057039 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" Jul 17 22:09:24.101364 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.101222 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:24.102506 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102474 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d86bd4a-ec07-4798-aaed-7608028ee9d5-config-volume\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.102635 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102526 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5wvw\" (UniqueName: \"kubernetes.io/projected/55ef691e-7927-4948-ad6c-e354a4b72add-kube-api-access-f5wvw\") pod \"network-check-source-7bc5b6bf85-cw2sg\" (UID: \"55ef691e-7927-4948-ad6c-e354a4b72add\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg" Jul 17 22:09:24.102635 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102563 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48da6edc-ec29-45af-b684-f3ae08d9d1e0-cert\") pod \"ingress-canary-tdl2l\" (UID: \"48da6edc-ec29-45af-b684-f3ae08d9d1e0\") " pod="openshift-ingress-canary/ingress-canary-tdl2l" Jul 17 22:09:24.102635 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-snapshots\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.102635 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d86bd4a-ec07-4798-aaed-7608028ee9d5-tmp-dir\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.102926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-service-ca-bundle\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.102926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njbqz\" (UniqueName: \"kubernetes.io/projected/48da6edc-ec29-45af-b684-f3ae08d9d1e0-kube-api-access-njbqz\") pod \"ingress-canary-tdl2l\" (UID: \"48da6edc-ec29-45af-b684-f3ae08d9d1e0\") " pod="openshift-ingress-canary/ingress-canary-tdl2l" Jul 17 22:09:24.102926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-tmp\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.102926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.102926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102801 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brd2g\" (UniqueName: \"kubernetes.io/projected/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-kube-api-access-brd2g\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.102926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.102926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkzq\" (UniqueName: \"kubernetes.io/projected/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-kube-api-access-phkzq\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.102926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102898 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-serving-cert\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.103282 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102951 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq69g\" (UniqueName: \"kubernetes.io/projected/8d86bd4a-ec07-4798-aaed-7608028ee9d5-kube-api-access-wq69g\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.103282 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.102985 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.103282 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.103019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.103282 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.103163 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d86bd4a-ec07-4798-aaed-7608028ee9d5-config-volume\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.104489 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.103545 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 22:09:24.104489 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.103611 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls podName:8d86bd4a-ec07-4798-aaed-7608028ee9d5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:24.603589454 +0000 UTC m=+36.761778138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls") pod "dns-default-46h6v" (UID: "8d86bd4a-ec07-4798-aaed-7608028ee9d5") : secret "dns-default-metrics-tls" not found Jul 17 22:09:24.104489 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.103806 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.104489 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.104208 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-service-ca-bundle\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.104489 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.104375 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-tmp\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.104489 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.104375 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-snapshots\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.104489 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.104430 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d86bd4a-ec07-4798-aaed-7608028ee9d5-tmp-dir\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.104847 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.104602 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.106033 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.106010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48da6edc-ec29-45af-b684-f3ae08d9d1e0-cert\") pod \"ingress-canary-tdl2l\" (UID: \"48da6edc-ec29-45af-b684-f3ae08d9d1e0\") " pod="openshift-ingress-canary/ingress-canary-tdl2l" Jul 17 22:09:24.108673 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.106969 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.108769 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.108693 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-serving-cert\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.116149 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.116064 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkzq\" (UniqueName: \"kubernetes.io/projected/b36c8f1e-c34e-4d9a-8f95-7b83e8390082-kube-api-access-phkzq\") pod \"insights-operator-555d9d7885-t4vf2\" (UID: \"b36c8f1e-c34e-4d9a-8f95-7b83e8390082\") " pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.121742 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.121675 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq69g\" (UniqueName: \"kubernetes.io/projected/8d86bd4a-ec07-4798-aaed-7608028ee9d5-kube-api-access-wq69g\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.122438 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.122272 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njbqz\" (UniqueName: \"kubernetes.io/projected/48da6edc-ec29-45af-b684-f3ae08d9d1e0-kube-api-access-njbqz\") pod \"ingress-canary-tdl2l\" (UID: \"48da6edc-ec29-45af-b684-f3ae08d9d1e0\") " pod="openshift-ingress-canary/ingress-canary-tdl2l" Jul 17 22:09:24.122940 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.122842 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brd2g\" (UniqueName: \"kubernetes.io/projected/82a8fba8-65a4-4b5a-9fc2-8af1587fe43c-kube-api-access-brd2g\") pod \"kube-storage-version-migrator-operator-7658d9b749-fm2jc\" (UID: \"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.125456 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.125409 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5wvw\" (UniqueName: \"kubernetes.io/projected/55ef691e-7927-4948-ad6c-e354a4b72add-kube-api-access-f5wvw\") pod \"network-check-source-7bc5b6bf85-cw2sg\" (UID: \"55ef691e-7927-4948-ad6c-e354a4b72add\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg" Jul 17 22:09:24.147851 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.147262 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-t4vf2" Jul 17 22:09:24.168053 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.167874 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" Jul 17 22:09:24.191688 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.190217 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m"] Jul 17 22:09:24.198981 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.198956 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn"] Jul 17 22:09:24.201819 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:24.201770 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcd820c_78b3_46a1_b833_dc6b5e3fbdc6.slice/crio-e5d66d84718ccc540f04b13762ff015bbde7865c8f5cd36ba65e08b221ef0bc5 WatchSource:0}: Error finding container e5d66d84718ccc540f04b13762ff015bbde7865c8f5cd36ba65e08b221ef0bc5: Status 404 returned error can't find the container with id e5d66d84718ccc540f04b13762ff015bbde7865c8f5cd36ba65e08b221ef0bc5 Jul 17 22:09:24.227435 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.227412 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tdl2l" Jul 17 22:09:24.244352 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.244105 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg" Jul 17 22:09:24.292826 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.292792 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-qdjzw"] Jul 17 22:09:24.298539 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:24.298485 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d083fe3_08ed_469c_beb3_31f10c742433.slice/crio-4f108b61050387ea11ec436f254a4e9bb218861bf5e4f9b62be072ac72c496e5 WatchSource:0}: Error finding container 4f108b61050387ea11ec436f254a4e9bb218861bf5e4f9b62be072ac72c496e5: Status 404 returned error can't find the container with id 4f108b61050387ea11ec436f254a4e9bb218861bf5e4f9b62be072ac72c496e5 Jul 17 22:09:24.335234 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.335151 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-t4vf2"] Jul 17 22:09:24.339811 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:24.339774 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36c8f1e_c34e_4d9a_8f95_7b83e8390082.slice/crio-4ba7d49dda3cd7afafc8c016fcb753442f7bffc28689451d6725146c19b41f58 WatchSource:0}: Error finding container 4ba7d49dda3cd7afafc8c016fcb753442f7bffc28689451d6725146c19b41f58: Status 404 returned error can't find the container with id 4ba7d49dda3cd7afafc8c016fcb753442f7bffc28689451d6725146c19b41f58 Jul 17 22:09:24.345834 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.345812 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc"] Jul 17 22:09:24.349186 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:24.349162 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a8fba8_65a4_4b5a_9fc2_8af1587fe43c.slice/crio-643377a6a51aa1a343b7e182b85209e3749be98f7a4aa7b0126f10fb28f4b8dd WatchSource:0}: Error finding container 643377a6a51aa1a343b7e182b85209e3749be98f7a4aa7b0126f10fb28f4b8dd: Status 404 returned error can't find the container with id 643377a6a51aa1a343b7e182b85209e3749be98f7a4aa7b0126f10fb28f4b8dd Jul 17 22:09:24.403313 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.402908 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tdl2l"] Jul 17 22:09:24.405382 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.405306 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg"] Jul 17 22:09:24.405645 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.405620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:24.405713 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.405668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:24.405760 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:24.405732 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48da6edc_ec29_45af_b684_f3ae08d9d1e0.slice/crio-52798caf8dc89311268eef2340591d82967d096b632a46f6eb945593f4ef04b0 WatchSource:0}: Error finding container 52798caf8dc89311268eef2340591d82967d096b632a46f6eb945593f4ef04b0: Status 404 returned error can't find the container with id 52798caf8dc89311268eef2340591d82967d096b632a46f6eb945593f4ef04b0 Jul 17 22:09:24.405803 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.405765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:24.405803 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.405783 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 22:09:24.405875 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.405846 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:25.405827713 +0000 UTC m=+37.564016399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : secret "router-metrics-certs-default" not found Jul 17 22:09:24.405875 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.405858 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 22:09:24.405875 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.405871 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8988cdf5-npmb7: secret "image-registry-tls" not found Jul 17 22:09:24.406031 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.405893 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:25.405878314 +0000 UTC m=+37.564066999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : configmap references non-existent config key: service-ca.crt Jul 17 22:09:24.406031 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.405911 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls podName:c08f5b67-bb9a-4585-b4d7-ffe841ce6826 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:25.405901922 +0000 UTC m=+37.564090608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls") pod "image-registry-6f8988cdf5-npmb7" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826") : secret "image-registry-tls" not found Jul 17 22:09:24.408988 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:24.408962 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ef691e_7927_4948_ad6c_e354a4b72add.slice/crio-26bf05e52e307c49cbbff7945133385ffa7a5e35a26b2c150f5cd7d0906ae90a WatchSource:0}: Error finding container 26bf05e52e307c49cbbff7945133385ffa7a5e35a26b2c150f5cd7d0906ae90a: Status 404 returned error can't find the container with id 26bf05e52e307c49cbbff7945133385ffa7a5e35a26b2c150f5cd7d0906ae90a Jul 17 22:09:24.409209 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.409188 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" event={"ID":"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c","Type":"ContainerStarted","Data":"643377a6a51aa1a343b7e182b85209e3749be98f7a4aa7b0126f10fb28f4b8dd"} Jul 17 22:09:24.412378 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.412356 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" event={"ID":"0d083fe3-08ed-469c-beb3-31f10c742433","Type":"ContainerStarted","Data":"4f108b61050387ea11ec436f254a4e9bb218861bf5e4f9b62be072ac72c496e5"} Jul 17 22:09:24.415083 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.415058 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76f636b-dc83-40aa-9bd3-62b7b7cfe85c" containerID="698532bf9cd991ad7ec20ad5290436aeb85b06f66cd77e010dcb6b35ee627b49" exitCode=0 Jul 17 22:09:24.415167 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.415147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" event={"ID":"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c","Type":"ContainerDied","Data":"698532bf9cd991ad7ec20ad5290436aeb85b06f66cd77e010dcb6b35ee627b49"} Jul 17 22:09:24.416229 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.416210 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-t4vf2" event={"ID":"b36c8f1e-c34e-4d9a-8f95-7b83e8390082","Type":"ContainerStarted","Data":"4ba7d49dda3cd7afafc8c016fcb753442f7bffc28689451d6725146c19b41f58"} Jul 17 22:09:24.417228 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.417209 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" event={"ID":"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6","Type":"ContainerStarted","Data":"e5d66d84718ccc540f04b13762ff015bbde7865c8f5cd36ba65e08b221ef0bc5"} Jul 17 22:09:24.418512 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.418488 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m" event={"ID":"8e4b1a65-ce08-4206-938a-7fa003385ce1","Type":"ContainerStarted","Data":"35f7a7f118052b0dbda7e07ee49ed27c1c102fc95be9ed33374cd36e1cb42b81"} Jul 17 22:09:24.507156 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.507126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:24.507302 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.507161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:24.507302 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.507282 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:24.507422 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.507346 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls podName:115aa6f9-ed4e-4851-85c4-295a61a232ff nodeName:}" failed. No retries permitted until 2026-07-17 22:09:25.507315844 +0000 UTC m=+37.665504526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8mjr5" (UID: "115aa6f9-ed4e-4851-85c4-295a61a232ff") : secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:24.507486 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.507454 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 22:09:24.507553 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.507535 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls podName:d354a993-b883-425a-9244-606c818ea254 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:25.50751617 +0000 UTC m=+37.665704866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kp5fl" (UID: "d354a993-b883-425a-9244-606c818ea254") : secret "samples-operator-tls" not found Jul 17 22:09:24.608548 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:24.608512 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:24.608696 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.608639 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 22:09:24.608733 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:24.608719 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls podName:8d86bd4a-ec07-4798-aaed-7608028ee9d5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:25.608701182 +0000 UTC m=+37.766889883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls") pod "dns-default-46h6v" (UID: "8d86bd4a-ec07-4798-aaed-7608028ee9d5") : secret "dns-default-metrics-tls" not found Jul 17 22:09:25.230605 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.229880 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:25.230605 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.229924 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:25.230605 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.230262 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:25.232760 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.232602 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 22:09:25.232917 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.232899 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 22:09:25.233930 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.233870 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xwnn\"" Jul 17 22:09:25.234380 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.234153 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zxkq\"" Jul 17 22:09:25.262619 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.262592 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:25.318267 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.318174 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:25.415121 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.415088 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:25.415293 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.415152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:25.415293 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.415213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:25.415470 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.415382 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 22:09:25.415470 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.415399 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8988cdf5-npmb7: secret "image-registry-tls" not found Jul 17 22:09:25.415470 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.415457 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls podName:c08f5b67-bb9a-4585-b4d7-ffe841ce6826 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:27.415437235 +0000 UTC m=+39.573625933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls") pod "image-registry-6f8988cdf5-npmb7" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826") : secret "image-registry-tls" not found Jul 17 22:09:25.415633 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.415535 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:27.41552382 +0000 UTC m=+39.573712505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : configmap references non-existent config key: service-ca.crt Jul 17 22:09:25.415633 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.415626 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 22:09:25.415729 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.415660 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:27.415648818 +0000 UTC m=+39.573837502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : secret "router-metrics-certs-default" not found Jul 17 22:09:25.426353 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.426248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg" event={"ID":"55ef691e-7927-4948-ad6c-e354a4b72add","Type":"ContainerStarted","Data":"26bf05e52e307c49cbbff7945133385ffa7a5e35a26b2c150f5cd7d0906ae90a"} Jul 17 22:09:25.430026 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.429955 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tdl2l" event={"ID":"48da6edc-ec29-45af-b684-f3ae08d9d1e0","Type":"ContainerStarted","Data":"52798caf8dc89311268eef2340591d82967d096b632a46f6eb945593f4ef04b0"} Jul 17 22:09:25.437391 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.437362 2556 generic.go:356] "Generic (PLEG): container finished" podID="d76f636b-dc83-40aa-9bd3-62b7b7cfe85c" containerID="d75e67c6948fc6fe14fa517c140e3cb39dd50655735f9c45dfb22f47fc6240ed" exitCode=0 Jul 17 22:09:25.437518 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.437417 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" event={"ID":"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c","Type":"ContainerDied","Data":"d75e67c6948fc6fe14fa517c140e3cb39dd50655735f9c45dfb22f47fc6240ed"} Jul 17 22:09:25.516632 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.516550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:25.516632 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.516603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:25.516966 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.516864 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:25.516966 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.516929 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls podName:115aa6f9-ed4e-4851-85c4-295a61a232ff nodeName:}" failed. No retries permitted until 2026-07-17 22:09:27.51691072 +0000 UTC m=+39.675099409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8mjr5" (UID: "115aa6f9-ed4e-4851-85c4-295a61a232ff") : secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:25.517390 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.517356 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 22:09:25.517467 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.517420 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls podName:d354a993-b883-425a-9244-606c818ea254 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:27.517403916 +0000 UTC m=+39.675592602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kp5fl" (UID: "d354a993-b883-425a-9244-606c818ea254") : secret "samples-operator-tls" not found Jul 17 22:09:25.619077 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:25.617448 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:25.619077 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.618163 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 22:09:25.619077 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:25.618221 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls podName:8d86bd4a-ec07-4798-aaed-7608028ee9d5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:27.61820238 +0000 UTC m=+39.776391067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls") pod "dns-default-46h6v" (UID: "8d86bd4a-ec07-4798-aaed-7608028ee9d5") : secret "dns-default-metrics-tls" not found Jul 17 22:09:26.151794 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.151501 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:26.251815 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.251712 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:26.349716 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.349610 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:26.404008 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.403920 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:26.449580 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.448698 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" event={"ID":"d76f636b-dc83-40aa-9bd3-62b7b7cfe85c","Type":"ContainerStarted","Data":"ab663e02e064d320238ecfe48d055f6d3707ebaf8f98cdbf0304e3af3a147fe6"} Jul 17 22:09:26.452143 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.451700 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m" event={"ID":"8e4b1a65-ce08-4206-938a-7fa003385ce1","Type":"ContainerStarted","Data":"bb9c9cdda2c436644feffb195ee7ff694f98df27afe9396cea6abd3faf4dcd60"} Jul 17 22:09:26.490203 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.490145 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nt4vl" podStartSLOduration=8.439115776 podStartE2EDuration="38.490122712s" totalImagesPullingTime="30.051006936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:26.474387128 +0000 UTC m=+38.632575832" watchObservedRunningTime="2026-07-17 22:09:26.490122712 +0000 UTC m=+38.648311417" Jul 17 22:09:26.490816 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.490778 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-g7d5m" podStartSLOduration=25.657186599 podStartE2EDuration="27.490768351s" totalImagesPullingTime="1.833581752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:26.489736119 +0000 UTC m=+38.647924823" watchObservedRunningTime="2026-07-17 22:09:26.490768351 +0000 UTC m=+38.648957055" Jul 17 22:09:26.562800 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.562680 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:26.615377 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:26.615215 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:27.089388 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.089323 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:27.142429 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.142386 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:27.438888 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.438853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:27.439580 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.438911 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:27.439580 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.439014 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 22:09:27.439580 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.439039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:27.439580 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.439079 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:31.439060784 +0000 UTC m=+43.597249470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : secret "router-metrics-certs-default" not found Jul 17 22:09:27.439580 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.439132 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:31.439120081 +0000 UTC m=+43.597308766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : configmap references non-existent config key: service-ca.crt Jul 17 22:09:27.439580 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.439141 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 22:09:27.439580 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.439163 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8988cdf5-npmb7: secret "image-registry-tls" not found Jul 17 22:09:27.439580 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.439219 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls podName:c08f5b67-bb9a-4585-b4d7-ffe841ce6826 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:31.439201033 +0000 UTC m=+43.597389749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls") pod "image-registry-6f8988cdf5-npmb7" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826") : secret "image-registry-tls" not found Jul 17 22:09:27.450936 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.450912 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:27.540377 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.540320 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:27.540565 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.540385 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:27.540565 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.540501 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 22:09:27.540669 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.540578 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls podName:d354a993-b883-425a-9244-606c818ea254 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:31.540556076 +0000 UTC m=+43.698744863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kp5fl" (UID: "d354a993-b883-425a-9244-606c818ea254") : secret "samples-operator-tls" not found Jul 17 22:09:27.540669 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.540600 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:27.540669 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.540642 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls podName:115aa6f9-ed4e-4851-85c4-295a61a232ff nodeName:}" failed. No retries permitted until 2026-07-17 22:09:31.54062965 +0000 UTC m=+43.698818332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8mjr5" (UID: "115aa6f9-ed4e-4851-85c4-295a61a232ff") : secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:27.551162 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.551131 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:27.641776 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.641652 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:27.641776 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.641748 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 22:09:27.642061 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:27.641814 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls podName:8d86bd4a-ec07-4798-aaed-7608028ee9d5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:31.641795734 +0000 UTC m=+43.799984416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls") pod "dns-default-46h6v" (UID: "8d86bd4a-ec07-4798-aaed-7608028ee9d5") : secret "dns-default-metrics-tls" not found Jul 17 22:09:27.650919 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:27.650883 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:31.473515 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.473473 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:31.474051 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.473545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:31.474051 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.473594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:31.474051 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.473646 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:39.473627369 +0000 UTC m=+51.631816051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : configmap references non-existent config key: service-ca.crt Jul 17 22:09:31.474051 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.473646 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 22:09:31.474051 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.473708 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 22:09:31.474051 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.473723 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8988cdf5-npmb7: secret "image-registry-tls" not found Jul 17 22:09:31.474051 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.473745 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:39.473727395 +0000 UTC m=+51.631916079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : secret "router-metrics-certs-default" not found Jul 17 22:09:31.474051 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.473764 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls podName:c08f5b67-bb9a-4585-b4d7-ffe841ce6826 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:39.473754991 +0000 UTC m=+51.631943686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls") pod "image-registry-6f8988cdf5-npmb7" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826") : secret "image-registry-tls" not found Jul 17 22:09:31.574724 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.574687 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:31.574724 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.574724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:31.574998 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.574823 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:31.574998 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.574827 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 22:09:31.574998 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.574874 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls podName:115aa6f9-ed4e-4851-85c4-295a61a232ff nodeName:}" failed. No retries permitted until 2026-07-17 22:09:39.574861752 +0000 UTC m=+51.733050434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8mjr5" (UID: "115aa6f9-ed4e-4851-85c4-295a61a232ff") : secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:31.574998 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.574886 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls podName:d354a993-b883-425a-9244-606c818ea254 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:39.574879992 +0000 UTC m=+51.733068674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kp5fl" (UID: "d354a993-b883-425a-9244-606c818ea254") : secret "samples-operator-tls" not found Jul 17 22:09:31.616295 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.616264 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:31.671578 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.671546 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:31.675629 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.675608 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:31.675736 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.675724 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 22:09:31.675785 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:31.675771 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls podName:8d86bd4a-ec07-4798-aaed-7608028ee9d5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:39.675759837 +0000 UTC m=+51.833948520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls") pod "dns-default-46h6v" (UID: "8d86bd4a-ec07-4798-aaed-7608028ee9d5") : secret "dns-default-metrics-tls" not found Jul 17 22:09:31.772091 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:31.772066 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:32.108429 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.108382 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:32.160731 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.160688 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:32.471086 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.471049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-t4vf2" event={"ID":"b36c8f1e-c34e-4d9a-8f95-7b83e8390082","Type":"ContainerStarted","Data":"d81a9034ffb02bbcff3042c32bb17a30056e9cd471d7dd16811f9e35fbac55ec"} Jul 17 22:09:32.472730 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.472700 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" event={"ID":"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6","Type":"ContainerStarted","Data":"2056e00a8624976ea186d4b62057ba738444d2668947b818fc218b1bd2740bed"} Jul 17 22:09:32.474263 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.474235 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" event={"ID":"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c","Type":"ContainerStarted","Data":"6e0765a002e4866db095e62b2214df1c7870fde71a20191f462472483a9d74f2"} Jul 17 22:09:32.476620 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.476546 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg" event={"ID":"55ef691e-7927-4948-ad6c-e354a4b72add","Type":"ContainerStarted","Data":"71f4530f8db1156b451f50f4b6e99b258337bd8d123d2d926827c38d8d64fecf"} Jul 17 22:09:32.478139 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.478116 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tdl2l" event={"ID":"48da6edc-ec29-45af-b684-f3ae08d9d1e0","Type":"ContainerStarted","Data":"3eea387cd5768ebb72e8dea77af32789c0aada19fc867e98bd34d4995305e854"} Jul 17 22:09:32.480145 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.480125 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/0.log" Jul 17 22:09:32.480243 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.480164 2556 generic.go:356] "Generic (PLEG): container finished" podID="0d083fe3-08ed-469c-beb3-31f10c742433" containerID="61510f4cc9ea7a4c5db9dc5663fa509e151e729e30872dbe85effd82871f652e" exitCode=255 Jul 17 22:09:32.480243 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.480190 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" event={"ID":"0d083fe3-08ed-469c-beb3-31f10c742433","Type":"ContainerDied","Data":"61510f4cc9ea7a4c5db9dc5663fa509e151e729e30872dbe85effd82871f652e"} Jul 17 22:09:32.480445 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.480428 2556 scope.go:117] "RemoveContainer" containerID="61510f4cc9ea7a4c5db9dc5663fa509e151e729e30872dbe85effd82871f652e" Jul 17 22:09:32.490103 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.490047 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-t4vf2" podStartSLOduration=26.046960672 podStartE2EDuration="33.490028201s" totalImagesPullingTime="7.443067529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:32.488266857 +0000 UTC m=+44.646455564" watchObservedRunningTime="2026-07-17 22:09:32.490028201 +0000 UTC m=+44.648216886" Jul 17 22:09:32.503179 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.502113 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-cw2sg" podStartSLOduration=26.120391747 podStartE2EDuration="33.502093463s" totalImagesPullingTime="7.381701716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:32.501883661 +0000 UTC m=+44.660072366" watchObservedRunningTime="2026-07-17 22:09:32.502093463 +0000 UTC m=+44.660282148" Jul 17 22:09:32.564116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.563586 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" podStartSLOduration=25.981858399 podStartE2EDuration="33.563562755s" totalImagesPullingTime="7.581704356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:32.522675885 +0000 UTC m=+44.680864593" watchObservedRunningTime="2026-07-17 22:09:32.563562755 +0000 UTC m=+44.721751457" Jul 17 22:09:32.592440 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.592384 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" podStartSLOduration=26.157475177 podStartE2EDuration="33.592363527s" totalImagesPullingTime="7.43488835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:32.591498865 +0000 UTC m=+44.749687571" watchObservedRunningTime="2026-07-17 22:09:32.592363527 +0000 UTC m=+44.750552233" Jul 17 22:09:32.615119 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.614989 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tdl2l" podStartSLOduration=2.237174827 podStartE2EDuration="9.614970363s" totalImagesPullingTime="7.377795536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:32.613890553 +0000 UTC m=+44.772079270" watchObservedRunningTime="2026-07-17 22:09:32.614970363 +0000 UTC m=+44.773159067" Jul 17 22:09:32.694755 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.694727 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:32.751404 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:32.751299 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.048467 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.048370 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.120586 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.120556 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.184644 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.184612 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.485976 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.485948 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/1.log" Jul 17 22:09:33.486474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.486457 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/0.log" Jul 17 22:09:33.486537 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.486501 2556 generic.go:356] "Generic (PLEG): container finished" podID="0d083fe3-08ed-469c-beb3-31f10c742433" containerID="32847c92f65e0e3fe48f181d083e1c8a3d2a487b7a3030dae861b198e4a4a771" exitCode=255 Jul 17 22:09:33.486621 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.486600 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" event={"ID":"0d083fe3-08ed-469c-beb3-31f10c742433","Type":"ContainerDied","Data":"32847c92f65e0e3fe48f181d083e1c8a3d2a487b7a3030dae861b198e4a4a771"} Jul 17 22:09:33.486670 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.486653 2556 scope.go:117] "RemoveContainer" containerID="61510f4cc9ea7a4c5db9dc5663fa509e151e729e30872dbe85effd82871f652e" Jul 17 22:09:33.487035 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.487013 2556 scope.go:117] "RemoveContainer" containerID="32847c92f65e0e3fe48f181d083e1c8a3d2a487b7a3030dae861b198e4a4a771" Jul 17 22:09:33.487212 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:33.487187 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-qdjzw_openshift-console-operator(0d083fe3-08ed-469c-beb3-31f10c742433)\"" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" podUID="0d083fe3-08ed-469c-beb3-31f10c742433" Jul 17 22:09:33.577212 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.577178 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.678093 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.678055 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.800842 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.800759 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.901379 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.901348 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.942555 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.942523 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9cwt7"] Jul 17 22:09:33.973539 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.973506 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9cwt7"] Jul 17 22:09:33.973691 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.973633 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:33.976413 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.976393 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 22:09:33.976413 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.976406 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xpf8k\"" Jul 17 22:09:33.976597 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.976424 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 22:09:33.981135 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.981099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:33.997708 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.997682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d135016a-fb35-4b02-8cf6-e99c32b83ce9-crio-socket\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:33.997826 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.997724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d135016a-fb35-4b02-8cf6-e99c32b83ce9-data-volume\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:33.997826 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.997745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:33.997826 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.997812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:33.997924 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:33.997899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lxhq\" (UniqueName: \"kubernetes.io/projected/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-api-access-5lxhq\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.099262 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.099168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lxhq\" (UniqueName: \"kubernetes.io/projected/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-api-access-5lxhq\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.099262 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.099256 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d135016a-fb35-4b02-8cf6-e99c32b83ce9-crio-socket\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.099539 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.099304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d135016a-fb35-4b02-8cf6-e99c32b83ce9-data-volume\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.099539 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.099326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.099539 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.099450 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 22:09:34.099539 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.099487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.099539 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.099511 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:34.599491336 +0000 UTC m=+46.757680037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : secret "insights-runtime-extractor-tls" not found Jul 17 22:09:34.099539 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.099524 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d135016a-fb35-4b02-8cf6-e99c32b83ce9-crio-socket\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.099768 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.099541 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 22:09:34.099768 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.099611 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:34.599593966 +0000 UTC m=+46.757782666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : configmap "kube-rbac-proxy" not found Jul 17 22:09:34.099768 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.099662 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d135016a-fb35-4b02-8cf6-e99c32b83ce9-data-volume\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.102075 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.102061 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:34.102114 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.102097 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:34.111449 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.111427 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lxhq\" (UniqueName: \"kubernetes.io/projected/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-api-access-5lxhq\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.369573 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.369482 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:34.422375 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.422343 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:34.491976 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.491950 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/1.log" Jul 17 22:09:34.492462 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.492372 2556 scope.go:117] "RemoveContainer" containerID="32847c92f65e0e3fe48f181d083e1c8a3d2a487b7a3030dae861b198e4a4a771" Jul 17 22:09:34.492590 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.492567 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-qdjzw_openshift-console-operator(0d083fe3-08ed-469c-beb3-31f10c742433)\"" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" podUID="0d083fe3-08ed-469c-beb3-31f10c742433" Jul 17 22:09:34.511635 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.511603 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:34.575139 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.575108 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:34.604727 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.604690 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.604913 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.604889 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 22:09:34.604983 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.604958 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:35.604941009 +0000 UTC m=+47.763129691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : configmap "kube-rbac-proxy" not found Jul 17 22:09:34.605111 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:34.605022 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:34.605175 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.605146 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 22:09:34.605234 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:34.605219 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:35.605198747 +0000 UTC m=+47.763387444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : secret "insights-runtime-extractor-tls" not found Jul 17 22:09:35.497991 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:35.497955 2556 scope.go:117] "RemoveContainer" containerID="32847c92f65e0e3fe48f181d083e1c8a3d2a487b7a3030dae861b198e4a4a771" Jul 17 22:09:35.498459 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:35.498219 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-qdjzw_openshift-console-operator(0d083fe3-08ed-469c-beb3-31f10c742433)\"" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" podUID="0d083fe3-08ed-469c-beb3-31f10c742433" Jul 17 22:09:35.615589 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:35.615553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:35.615776 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:35.615677 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 22:09:35.615776 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:35.615703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:35.615776 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:35.615741 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:37.615725075 +0000 UTC m=+49.773913758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : configmap "kube-rbac-proxy" not found Jul 17 22:09:35.615903 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:35.615794 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 22:09:35.615903 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:35.615848 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:37.615833137 +0000 UTC m=+49.774021834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : secret "insights-runtime-extractor-tls" not found Jul 17 22:09:36.137394 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:36.137356 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:36.239610 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:36.239568 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:36.337894 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:36.337859 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:36.537549 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:36.537520 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k2pss_26ca3f5f-aaba-4e34-ae88-97245f318cf4/dns-node-resolver/0.log" Jul 17 22:09:37.100490 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:37.100440 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:37.139009 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:37.138984 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4zdhk_0e9a1ee0-6b84-460c-97a9-7604811a6a6a/node-ca/0.log" Jul 17 22:09:37.631848 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:37.631808 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:37.632255 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:37.631941 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 22:09:37.632255 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:37.632003 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:41.631987129 +0000 UTC m=+53.790175811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : configmap "kube-rbac-proxy" not found Jul 17 22:09:37.632255 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:37.631945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:37.632255 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:37.632022 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 22:09:37.632255 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:37.632078 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:41.632064157 +0000 UTC m=+53.790252845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : secret "insights-runtime-extractor-tls" not found Jul 17 22:09:38.138890 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:38.138820 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tdl2l_48da6edc-ec29-45af-b684-f3ae08d9d1e0/serve-healthcheck-canary/0.log" Jul 17 22:09:38.739091 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:38.739060 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-fm2jc_82a8fba8-65a4-4b5a-9fc2-8af1587fe43c/kube-storage-version-migrator-operator/0.log" Jul 17 22:09:39.547941 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:39.547904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:39.548133 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:39.547958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:39.548133 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:39.547991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:39.548133 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.548075 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:55.54805688 +0000 UTC m=+67.706245562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : configmap references non-existent config key: service-ca.crt Jul 17 22:09:39.548133 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.548121 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 22:09:39.548355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.548167 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs podName:d2a59372-e2fc-4941-8504-f5c3ae176332 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:55.548156006 +0000 UTC m=+67.706344688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs") pod "router-default-64fd77f47d-9w6vw" (UID: "d2a59372-e2fc-4941-8504-f5c3ae176332") : secret "router-metrics-certs-default" not found Jul 17 22:09:39.548355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.548121 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 22:09:39.548355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.548186 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8988cdf5-npmb7: secret "image-registry-tls" not found Jul 17 22:09:39.548355 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.548214 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls podName:c08f5b67-bb9a-4585-b4d7-ffe841ce6826 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:55.548205095 +0000 UTC m=+67.706393776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls") pod "image-registry-6f8988cdf5-npmb7" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826") : secret "image-registry-tls" not found Jul 17 22:09:39.648877 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:39.648835 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:39.649054 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:39.648890 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:39.649054 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.649012 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 22:09:39.649166 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.649053 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:39.649166 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.649077 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls podName:d354a993-b883-425a-9244-606c818ea254 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:55.649062851 +0000 UTC m=+67.807251533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-kp5fl" (UID: "d354a993-b883-425a-9244-606c818ea254") : secret "samples-operator-tls" not found Jul 17 22:09:39.649166 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.649112 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls podName:115aa6f9-ed4e-4851-85c4-295a61a232ff nodeName:}" failed. No retries permitted until 2026-07-17 22:09:55.649094896 +0000 UTC m=+67.807283580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8mjr5" (UID: "115aa6f9-ed4e-4851-85c4-295a61a232ff") : secret "cluster-monitoring-operator-tls" not found Jul 17 22:09:39.750377 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:39.750308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:39.750751 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.750459 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 22:09:39.750751 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:39.750525 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls podName:8d86bd4a-ec07-4798-aaed-7608028ee9d5 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:55.750508102 +0000 UTC m=+67.908696794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls") pod "dns-default-46h6v" (UID: "8d86bd4a-ec07-4798-aaed-7608028ee9d5") : secret "dns-default-metrics-tls" not found Jul 17 22:09:39.876240 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:39.876160 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:39.977085 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:39.977054 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:40.100930 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:40.100899 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:40.198743 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:40.198694 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:40.300801 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:40.300766 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:40.434531 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:40.434486 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:40.581157 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:40.581081 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:41.366636 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:41.366593 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:41.668347 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:41.668242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:41.668347 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:41.668299 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:41.668541 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:41.668371 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 22:09:41.668541 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:41.668414 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 22:09:41.668541 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:41.668428 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:49.668412903 +0000 UTC m=+61.826601585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : configmap "kube-rbac-proxy" not found Jul 17 22:09:41.668541 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:41.668511 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:09:49.668492428 +0000 UTC m=+61.826681117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : secret "insights-runtime-extractor-tls" not found Jul 17 22:09:41.968471 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:41.968437 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:42.168647 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:42.168618 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:42.369169 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:42.369068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:42.604895 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:42.604849 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:42.770214 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:42.770177 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:43.377461 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:43.377427 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:43.571721 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:43.571674 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:43.673142 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:43.673070 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:43.773824 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:43.773790 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:44.023284 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:44.023253 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:44.369750 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:44.369666 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:44.420562 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:44.420529 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:45.168073 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:45.168040 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:45.569086 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:45.569052 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:45.765079 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:45.765043 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:45.969961 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:45.969932 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:46.069747 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:46.069716 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:46.212126 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:46.212095 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:46.368497 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:46.368425 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:46.966850 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:46.966803 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:47.355223 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:47.355144 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:47.409667 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:47.409636 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:47.411014 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:47.410992 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cwcjd" Jul 17 22:09:47.771583 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:47.771541 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:47.969417 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:47.969296 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:48.224048 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.223984 2556 scope.go:117] "RemoveContainer" containerID="32847c92f65e0e3fe48f181d083e1c8a3d2a487b7a3030dae861b198e4a4a771" Jul 17 22:09:48.537177 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.537102 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/1.log" Jul 17 22:09:48.537323 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.537183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" event={"ID":"0d083fe3-08ed-469c-beb3-31f10c742433","Type":"ContainerStarted","Data":"ee1110e7cd5793f31a8d47af170f0751a7239dec1eaf478c1eef90146552a11c"} Jul 17 22:09:48.537477 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.537460 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:48.554386 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.554327 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" podStartSLOduration=42.069590526 podStartE2EDuration="49.554310043s" totalImagesPullingTime="7.484719517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:48.553177011 +0000 UTC m=+60.711365736" watchObservedRunningTime="2026-07-17 22:09:48.554310043 +0000 UTC m=+60.712498810" Jul 17 22:09:48.569505 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.569470 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:48.652164 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.652138 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-qdjzw" Jul 17 22:09:48.831504 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.831421 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:48.936801 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:48.936773 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.123874 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.123778 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.228824 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.228775 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.375494 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.375418 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.438205 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.438170 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.516918 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.516883 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.617520 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.617482 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.739771 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.739737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:49.739938 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.739883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:49.740000 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:49.739988 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 22:09:49.740056 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:09:49.740047 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls podName:d135016a-fb35-4b02-8cf6-e99c32b83ce9 nodeName:}" failed. No retries permitted until 2026-07-17 22:10:05.740032986 +0000 UTC m=+77.898221667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9cwt7" (UID: "d135016a-fb35-4b02-8cf6-e99c32b83ce9") : secret "insights-runtime-extractor-tls" not found Jul 17 22:09:49.740274 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.740257 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d135016a-fb35-4b02-8cf6-e99c32b83ce9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:09:49.772526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.772497 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.937892 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.937861 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:49.993288 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:49.993208 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:50.174195 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:50.174162 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:50.565158 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:50.565127 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:50.718594 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:50.718564 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:50.914884 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:50.914815 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:51.192074 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:51.192044 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:51.536906 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:51.536818 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:51.596592 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:51.596565 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:54.077388 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.077354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:54.077388 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.077394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:54.080008 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.079985 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 22:09:54.080130 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.079989 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 22:09:54.090245 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.090221 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39c40759-5ff2-450f-8541-91ae0a4fa8b5-metrics-certs\") pod \"network-metrics-daemon-p7khv\" (UID: \"39c40759-5ff2-450f-8541-91ae0a4fa8b5\") " pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:54.090358 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.090301 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7906899-be0c-4a35-bfdb-2aff51baf928-original-pull-secret\") pod \"global-pull-secret-syncer-7wlr8\" (UID: \"f7906899-be0c-4a35-bfdb-2aff51baf928\") " pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:54.178437 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.178401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:54.180823 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.180804 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqm4f\" (UniqueName: \"kubernetes.io/projected/950dd0ed-0446-4c16-a439-6bb1f039ff57-kube-api-access-gqm4f\") pod \"network-check-target-gdhb8\" (UID: \"950dd0ed-0446-4c16-a439-6bb1f039ff57\") " pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:54.349891 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.349816 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xwnn\"" Jul 17 22:09:54.356133 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.356113 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wlr8" Jul 17 22:09:54.358245 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.358227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:54.367122 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.367105 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zxkq\"" Jul 17 22:09:54.375151 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.375138 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7khv" Jul 17 22:09:54.525749 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.525720 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7wlr8"] Jul 17 22:09:54.528537 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:54.528506 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7906899_be0c_4a35_bfdb_2aff51baf928.slice/crio-38c0b76227901cbc050ea858493528ee0a0844c89710e427d3bb1a1e046fc6ed WatchSource:0}: Error finding container 38c0b76227901cbc050ea858493528ee0a0844c89710e427d3bb1a1e046fc6ed: Status 404 returned error can't find the container with id 38c0b76227901cbc050ea858493528ee0a0844c89710e427d3bb1a1e046fc6ed Jul 17 22:09:54.546531 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.546500 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdhb8"] Jul 17 22:09:54.549813 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:54.549787 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950dd0ed_0446_4c16_a439_6bb1f039ff57.slice/crio-301d126f16aab25a9d0213f81a5e46a374208b99766286efd9441a6bd1c790db WatchSource:0}: Error finding container 301d126f16aab25a9d0213f81a5e46a374208b99766286efd9441a6bd1c790db: Status 404 returned error can't find the container with id 301d126f16aab25a9d0213f81a5e46a374208b99766286efd9441a6bd1c790db Jul 17 22:09:54.555514 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.555490 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdhb8" event={"ID":"950dd0ed-0446-4c16-a439-6bb1f039ff57","Type":"ContainerStarted","Data":"301d126f16aab25a9d0213f81a5e46a374208b99766286efd9441a6bd1c790db"} Jul 17 22:09:54.556526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.556497 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7wlr8" event={"ID":"f7906899-be0c-4a35-bfdb-2aff51baf928","Type":"ContainerStarted","Data":"38c0b76227901cbc050ea858493528ee0a0844c89710e427d3bb1a1e046fc6ed"} Jul 17 22:09:54.575363 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:54.575327 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p7khv"] Jul 17 22:09:54.577174 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:54.577146 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c40759_5ff2_450f_8541_91ae0a4fa8b5.slice/crio-642e4638a9057ede0b3743e9b9c3d4c9289189f09a453adc5f5d6df4ab44089a WatchSource:0}: Error finding container 642e4638a9057ede0b3743e9b9c3d4c9289189f09a453adc5f5d6df4ab44089a: Status 404 returned error can't find the container with id 642e4638a9057ede0b3743e9b9c3d4c9289189f09a453adc5f5d6df4ab44089a Jul 17 22:09:55.563380 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.563320 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdhb8" event={"ID":"950dd0ed-0446-4c16-a439-6bb1f039ff57","Type":"ContainerStarted","Data":"32ad35f83455b1fc165d03b863d2004e4e17be856c1a1c2935051be630cf1822"} Jul 17 22:09:55.563833 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.563474 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:09:55.564880 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.564849 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7khv" event={"ID":"39c40759-5ff2-450f-8541-91ae0a4fa8b5","Type":"ContainerStarted","Data":"642e4638a9057ede0b3743e9b9c3d4c9289189f09a453adc5f5d6df4ab44089a"} Jul 17 22:09:55.579646 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.579596 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gdhb8" podStartSLOduration=67.579583592 podStartE2EDuration="1m7.579583592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:55.578324116 +0000 UTC m=+67.736512821" watchObservedRunningTime="2026-07-17 22:09:55.579583592 +0000 UTC m=+67.737772325" Jul 17 22:09:55.590374 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.590341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:55.590526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.590397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:55.590526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.590433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:55.591027 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.590989 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2a59372-e2fc-4941-8504-f5c3ae176332-service-ca-bundle\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:55.593174 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.593150 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"image-registry-6f8988cdf5-npmb7\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:55.593268 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.593152 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a59372-e2fc-4941-8504-f5c3ae176332-metrics-certs\") pod \"router-default-64fd77f47d-9w6vw\" (UID: \"d2a59372-e2fc-4941-8504-f5c3ae176332\") " pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:55.691041 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.690998 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:55.691206 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.691047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:55.693577 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.693549 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d354a993-b883-425a-9244-606c818ea254-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-kp5fl\" (UID: \"d354a993-b883-425a-9244-606c818ea254\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:55.693685 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.693594 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/115aa6f9-ed4e-4851-85c4-295a61a232ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8mjr5\" (UID: \"115aa6f9-ed4e-4851-85c4-295a61a232ff\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:55.792055 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.792016 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:55.794494 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.794470 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d86bd4a-ec07-4798-aaed-7608028ee9d5-metrics-tls\") pod \"dns-default-46h6v\" (UID: \"8d86bd4a-ec07-4798-aaed-7608028ee9d5\") " pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:55.794762 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.794740 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rdp6m\"" Jul 17 22:09:55.802836 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.802820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:55.815319 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.815269 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcqbk\"" Jul 17 22:09:55.823913 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.823889 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:55.879656 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.879624 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-742ss\"" Jul 17 22:09:55.887847 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.887821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" Jul 17 22:09:55.925783 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.925749 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qsf44\"" Jul 17 22:09:55.933971 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:55.933948 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" Jul 17 22:09:56.038257 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.038040 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2w95\"" Jul 17 22:09:56.045864 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.045570 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46h6v" Jul 17 22:09:56.166248 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.165954 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f8988cdf5-npmb7"] Jul 17 22:09:56.168442 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:56.168414 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08f5b67_bb9a_4585_b4d7_ffe841ce6826.slice/crio-4c5a65a9017e9a4e36ea8a78ef7c776bff13cdd6387f9b8974d983e658936a84 WatchSource:0}: Error finding container 4c5a65a9017e9a4e36ea8a78ef7c776bff13cdd6387f9b8974d983e658936a84: Status 404 returned error can't find the container with id 4c5a65a9017e9a4e36ea8a78ef7c776bff13cdd6387f9b8974d983e658936a84 Jul 17 22:09:56.252734 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.252623 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-46h6v"] Jul 17 22:09:56.257759 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:56.256374 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d86bd4a_ec07_4798_aaed_7608028ee9d5.slice/crio-fa7f9a423717c6e744c7de8a251effa1a4f8d209698a5696d1e9d8e8ca804a56 WatchSource:0}: Error finding container fa7f9a423717c6e744c7de8a251effa1a4f8d209698a5696d1e9d8e8ca804a56: Status 404 returned error can't find the container with id fa7f9a423717c6e744c7de8a251effa1a4f8d209698a5696d1e9d8e8ca804a56 Jul 17 22:09:56.395120 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.395095 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5"] Jul 17 22:09:56.399477 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:56.399442 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115aa6f9_ed4e_4851_85c4_295a61a232ff.slice/crio-22f4e656ed18896f126055413cecbda7a27fbdb32ec81eaa8627f418af231dc6 WatchSource:0}: Error finding container 22f4e656ed18896f126055413cecbda7a27fbdb32ec81eaa8627f418af231dc6: Status 404 returned error can't find the container with id 22f4e656ed18896f126055413cecbda7a27fbdb32ec81eaa8627f418af231dc6 Jul 17 22:09:56.400649 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.400112 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64fd77f47d-9w6vw"] Jul 17 22:09:56.402065 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.401389 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl"] Jul 17 22:09:56.403660 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:09:56.403635 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a59372_e2fc_4941_8504_f5c3ae176332.slice/crio-21d9c32f619147f1f5008e933a93ad1b8b8b108fee9b808483e1e2c2a394f58e WatchSource:0}: Error finding container 21d9c32f619147f1f5008e933a93ad1b8b8b108fee9b808483e1e2c2a394f58e: Status 404 returned error can't find the container with id 21d9c32f619147f1f5008e933a93ad1b8b8b108fee9b808483e1e2c2a394f58e Jul 17 22:09:56.570734 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.570693 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46h6v" event={"ID":"8d86bd4a-ec07-4798-aaed-7608028ee9d5","Type":"ContainerStarted","Data":"fa7f9a423717c6e744c7de8a251effa1a4f8d209698a5696d1e9d8e8ca804a56"} Jul 17 22:09:56.572156 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.572127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" event={"ID":"115aa6f9-ed4e-4851-85c4-295a61a232ff","Type":"ContainerStarted","Data":"22f4e656ed18896f126055413cecbda7a27fbdb32ec81eaa8627f418af231dc6"} Jul 17 22:09:56.573732 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.573710 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" event={"ID":"c08f5b67-bb9a-4585-b4d7-ffe841ce6826","Type":"ContainerStarted","Data":"56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848"} Jul 17 22:09:56.573857 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.573747 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" event={"ID":"c08f5b67-bb9a-4585-b4d7-ffe841ce6826","Type":"ContainerStarted","Data":"4c5a65a9017e9a4e36ea8a78ef7c776bff13cdd6387f9b8974d983e658936a84"} Jul 17 22:09:56.573857 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.573794 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:09:56.575902 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.575862 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7khv" event={"ID":"39c40759-5ff2-450f-8541-91ae0a4fa8b5","Type":"ContainerStarted","Data":"a3deab041e9124d5e9eb2b89da68f1efc3e36ffb3104edacc1356967742d0882"} Jul 17 22:09:56.576032 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.575911 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7khv" event={"ID":"39c40759-5ff2-450f-8541-91ae0a4fa8b5","Type":"ContainerStarted","Data":"f64a145476afec1749188583bd6dd6133c8a23fc647e014d5526839a162042d4"} Jul 17 22:09:56.578378 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.578295 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" event={"ID":"d354a993-b883-425a-9244-606c818ea254","Type":"ContainerStarted","Data":"9e514a31a624734dc5b5310b05c29920eefb30a28a9cae6a1d540ea83f679604"} Jul 17 22:09:56.580672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.580619 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" event={"ID":"d2a59372-e2fc-4941-8504-f5c3ae176332","Type":"ContainerStarted","Data":"345f3d8eff161639a5b26186c289653cc786faf0a6d54a52fe1e0dde32951d19"} Jul 17 22:09:56.580672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.580652 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" event={"ID":"d2a59372-e2fc-4941-8504-f5c3ae176332","Type":"ContainerStarted","Data":"21d9c32f619147f1f5008e933a93ad1b8b8b108fee9b808483e1e2c2a394f58e"} Jul 17 22:09:56.593402 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.593364 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" podStartSLOduration=68.593350906 podStartE2EDuration="1m8.593350906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:56.592035964 +0000 UTC m=+68.750224685" watchObservedRunningTime="2026-07-17 22:09:56.593350906 +0000 UTC m=+68.751539603" Jul 17 22:09:56.607402 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.607320 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p7khv" podStartSLOduration=67.210865339 podStartE2EDuration="1m8.607304189s" totalImagesPullingTime="1.39643885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:56.606734562 +0000 UTC m=+68.764923267" watchObservedRunningTime="2026-07-17 22:09:56.607304189 +0000 UTC m=+68.765492893" Jul 17 22:09:56.625700 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.625654 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" podStartSLOduration=57.625638748 podStartE2EDuration="57.625638748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:09:56.625286955 +0000 UTC m=+68.783475658" watchObservedRunningTime="2026-07-17 22:09:56.625638748 +0000 UTC m=+68.783827445" Jul 17 22:09:56.803546 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.803495 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:56.806616 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:56.806588 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:57.330565 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.330399 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x"] Jul 17 22:09:57.333000 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.332725 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.336472 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.336441 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 17 22:09:57.337730 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.337502 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 22:09:57.337730 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.337537 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 22:09:57.337730 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.337656 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 22:09:57.346682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.346356 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x"] Jul 17 22:09:57.378753 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.378700 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:57.407476 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.407441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c85b0d2d-9712-4f47-af7f-9f61ec35e840-klusterlet-config\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.407682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.407495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c85b0d2d-9712-4f47-af7f-9f61ec35e840-tmp\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.407682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.407534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcwsn\" (UniqueName: \"kubernetes.io/projected/c85b0d2d-9712-4f47-af7f-9f61ec35e840-kube-api-access-mcwsn\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.414490 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.414458 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-q9656"] Jul 17 22:09:57.417122 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.417088 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-q9656" Jul 17 22:09:57.422726 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.422704 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 22:09:57.422840 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.422792 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 22:09:57.423118 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.422954 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-prjtk\"" Jul 17 22:09:57.434890 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.432169 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-q9656"] Jul 17 22:09:57.469620 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.469511 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:57.508937 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.508904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c85b0d2d-9712-4f47-af7f-9f61ec35e840-klusterlet-config\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.508937 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.508943 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c85b0d2d-9712-4f47-af7f-9f61ec35e840-tmp\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.509190 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.508968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nv8h\" (UniqueName: \"kubernetes.io/projected/6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4-kube-api-access-7nv8h\") pod \"downloads-5bc67dcd46-q9656\" (UID: \"6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4\") " pod="openshift-console/downloads-5bc67dcd46-q9656" Jul 17 22:09:57.509190 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.509017 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcwsn\" (UniqueName: \"kubernetes.io/projected/c85b0d2d-9712-4f47-af7f-9f61ec35e840-kube-api-access-mcwsn\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.510237 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.509829 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c85b0d2d-9712-4f47-af7f-9f61ec35e840-tmp\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.513522 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.513476 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c85b0d2d-9712-4f47-af7f-9f61ec35e840-klusterlet-config\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.525295 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.525253 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcwsn\" (UniqueName: \"kubernetes.io/projected/c85b0d2d-9712-4f47-af7f-9f61ec35e840-kube-api-access-mcwsn\") pod \"klusterlet-addon-workmgr-547b9cd8f5-qwb7x\" (UID: \"c85b0d2d-9712-4f47-af7f-9f61ec35e840\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.562588 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.562552 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:57.587545 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.587465 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:57.588573 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.588551 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64fd77f47d-9w6vw" Jul 17 22:09:57.610194 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.610129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nv8h\" (UniqueName: \"kubernetes.io/projected/6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4-kube-api-access-7nv8h\") pod \"downloads-5bc67dcd46-q9656\" (UID: \"6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4\") " pod="openshift-console/downloads-5bc67dcd46-q9656" Jul 17 22:09:57.628465 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.628276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nv8h\" (UniqueName: \"kubernetes.io/projected/6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4-kube-api-access-7nv8h\") pod \"downloads-5bc67dcd46-q9656\" (UID: \"6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4\") " pod="openshift-console/downloads-5bc67dcd46-q9656" Jul 17 22:09:57.656478 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.655518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:09:57.710921 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.710889 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:57.732959 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.732928 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-q9656" Jul 17 22:09:57.805538 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.805494 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:57.982488 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.982451 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:57.993472 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.993442 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55d5884786-6scxk"] Jul 17 22:09:57.997056 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.997027 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.000139 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:57.999973 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 22:09:58.000269 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.000186 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 22:09:58.000269 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.000192 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 22:09:58.000269 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.000260 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-srgm9\"" Jul 17 22:09:58.000587 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.000570 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 22:09:58.000785 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.000770 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 22:09:58.006102 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.006036 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d5884786-6scxk"] Jul 17 22:09:58.075677 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.075637 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:58.115085 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.115049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd6nm\" (UniqueName: \"kubernetes.io/projected/11a96acc-e265-4e06-9b18-580f90a87273-kube-api-access-hd6nm\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.115273 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.115102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-oauth-serving-cert\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.115273 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.115136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-console-config\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.115273 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.115172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-serving-cert\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.115273 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.115212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-oauth-config\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.115514 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.115358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-service-ca\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.216345 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.216289 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-service-ca\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.216528 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.216368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd6nm\" (UniqueName: \"kubernetes.io/projected/11a96acc-e265-4e06-9b18-580f90a87273-kube-api-access-hd6nm\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.216528 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.216405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-oauth-serving-cert\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.216528 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.216429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-console-config\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.216528 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.216460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-serving-cert\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.216528 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.216495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-oauth-config\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.217204 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.217143 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-service-ca\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.217204 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.217148 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-oauth-serving-cert\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.217411 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.217301 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-console-config\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.219460 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.219434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-oauth-config\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.219674 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.219629 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-serving-cert\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.224535 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.224491 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd6nm\" (UniqueName: \"kubernetes.io/projected/11a96acc-e265-4e06-9b18-580f90a87273-kube-api-access-hd6nm\") pod \"console-55d5884786-6scxk\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.311934 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.311854 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:09:58.425652 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.425593 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:58.496176 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.496133 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:58.555129 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.555100 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:58.742718 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.742679 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:58.841049 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:58.841006 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:59.151353 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:59.151248 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:59.208779 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:59.208739 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:09:59.949171 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:09:59.949130 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:00.156615 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.156576 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:00.213527 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.213437 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:00.343266 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.343210 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:00.444162 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.444129 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:00.532530 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.531922 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-q9656"] Jul 17 22:10:00.550667 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.547936 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x"] Jul 17 22:10:00.563030 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.563002 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d5884786-6scxk"] Jul 17 22:10:00.586320 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:10:00.586280 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a96acc_e265_4e06_9b18_580f90a87273.slice/crio-cbc1b453913b96d48bbf2247c85c89cc47ebfc77adfbf96db5369959242ee9db WatchSource:0}: Error finding container cbc1b453913b96d48bbf2247c85c89cc47ebfc77adfbf96db5369959242ee9db: Status 404 returned error can't find the container with id cbc1b453913b96d48bbf2247c85c89cc47ebfc77adfbf96db5369959242ee9db Jul 17 22:10:00.604980 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.604887 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46h6v" event={"ID":"8d86bd4a-ec07-4798-aaed-7608028ee9d5","Type":"ContainerStarted","Data":"171a2d737ed96a242292d1ea8d544ddd8f7917bfe2e8ea31ecb5cd2ddc195d73"} Jul 17 22:10:00.608376 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.607575 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" event={"ID":"115aa6f9-ed4e-4851-85c4-295a61a232ff","Type":"ContainerStarted","Data":"bd4a7fd87c4e1f3f2f4c6c3fad5c8dd8642985005961705aab66fb7bffaa6d26"} Jul 17 22:10:00.612529 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.611306 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" event={"ID":"d354a993-b883-425a-9244-606c818ea254","Type":"ContainerStarted","Data":"c3dd9b5cfe84c83d6cca2d9a6e581296c449c4249dea1a043b7c893a553e78f2"} Jul 17 22:10:00.613761 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.613651 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-q9656" event={"ID":"6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4","Type":"ContainerStarted","Data":"ca8fdc58c73b9cffb807e48bb9280bd600e4dda7956d75584ebe5c7d535efe80"} Jul 17 22:10:00.616223 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.615975 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7wlr8" event={"ID":"f7906899-be0c-4a35-bfdb-2aff51baf928","Type":"ContainerStarted","Data":"166f9601a661ea919241026fcd83b0a1d12e640e47df219150f2f7b9010690e7"} Jul 17 22:10:00.618084 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.618063 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5884786-6scxk" event={"ID":"11a96acc-e265-4e06-9b18-580f90a87273","Type":"ContainerStarted","Data":"cbc1b453913b96d48bbf2247c85c89cc47ebfc77adfbf96db5369959242ee9db"} Jul 17 22:10:00.619509 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.619474 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" event={"ID":"c85b0d2d-9712-4f47-af7f-9f61ec35e840","Type":"ContainerStarted","Data":"c3a138ab6e782c2934ae931ea098668ccb812f1af20728c4dc71696e6f2d80de"} Jul 17 22:10:00.629893 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.629811 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8mjr5" podStartSLOduration=57.70644023 podStartE2EDuration="1m1.629793022s" totalImagesPullingTime="3.923352792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:00.627465074 +0000 UTC m=+72.785653778" watchObservedRunningTime="2026-07-17 22:10:00.629793022 +0000 UTC m=+72.787981727" Jul 17 22:10:00.666351 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.665717 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7wlr8" podStartSLOduration=66.87730499 podStartE2EDuration="1m12.665694094s" totalImagesPullingTime="5.788389104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:00.643884014 +0000 UTC m=+72.802072718" watchObservedRunningTime="2026-07-17 22:10:00.665694094 +0000 UTC m=+72.823882798" Jul 17 22:10:00.838537 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.838454 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:00.938233 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:00.938192 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:01.023888 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:01.023854 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:01.570860 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:01.570828 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:01.627246 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:01.627212 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46h6v" event={"ID":"8d86bd4a-ec07-4798-aaed-7608028ee9d5","Type":"ContainerStarted","Data":"976aab43cc5aca41e2310c1c9d68eed2159deb3a13fdc72aa26a16dfa5e98760"} Jul 17 22:10:01.627450 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:01.627381 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-46h6v" Jul 17 22:10:01.629666 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:01.629636 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" event={"ID":"d354a993-b883-425a-9244-606c818ea254","Type":"ContainerStarted","Data":"046e7438c26e63eda23efddea0c0985745c6f4b1c9d232dbfc3222b3ff92e3c6"} Jul 17 22:10:01.644479 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:01.644428 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-kp5fl" podStartSLOduration=58.777363723 podStartE2EDuration="1m2.644404908s" totalImagesPullingTime="3.867041185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:00.666465219 +0000 UTC m=+72.824653924" watchObservedRunningTime="2026-07-17 22:10:01.644404908 +0000 UTC m=+73.802593615" Jul 17 22:10:01.645118 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:01.645083 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-46h6v" podStartSLOduration=34.581477863 podStartE2EDuration="38.645072061s" totalImagesPullingTime="4.063594198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:01.643521064 +0000 UTC m=+73.801709768" watchObservedRunningTime="2026-07-17 22:10:01.645072061 +0000 UTC m=+73.803260764" Jul 17 22:10:04.410784 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:04.410742 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:04.506920 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:04.506885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:05.790520 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:05.790482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:10:05.793211 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:05.793184 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d135016a-fb35-4b02-8cf6-e99c32b83ce9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9cwt7\" (UID: \"d135016a-fb35-4b02-8cf6-e99c32b83ce9\") " pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:10:06.085709 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:06.085631 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xpf8k\"" Jul 17 22:10:06.093148 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:06.093112 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9cwt7" Jul 17 22:10:07.139210 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.139179 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:07.239907 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.239857 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:07.315393 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.315306 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9cwt7"] Jul 17 22:10:07.317250 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:10:07.317214 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd135016a_fb35_4b02_8cf6_e99c32b83ce9.slice/crio-13e87495cceba3bfaef5fb062eda3bca87392a10f2d233bd2b56b4f71baf92e1 WatchSource:0}: Error finding container 13e87495cceba3bfaef5fb062eda3bca87392a10f2d233bd2b56b4f71baf92e1: Status 404 returned error can't find the container with id 13e87495cceba3bfaef5fb062eda3bca87392a10f2d233bd2b56b4f71baf92e1 Jul 17 22:10:07.659678 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.659633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5884786-6scxk" event={"ID":"11a96acc-e265-4e06-9b18-580f90a87273","Type":"ContainerStarted","Data":"e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88"} Jul 17 22:10:07.661322 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.661279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" event={"ID":"c85b0d2d-9712-4f47-af7f-9f61ec35e840","Type":"ContainerStarted","Data":"dbb2d65fff21e4924f057c79ddd6b5c7ab42465b5db5a7707c4f2c9d79c00339"} Jul 17 22:10:07.661485 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.661459 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:10:07.662906 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.662872 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9cwt7" event={"ID":"d135016a-fb35-4b02-8cf6-e99c32b83ce9","Type":"ContainerStarted","Data":"13e87495cceba3bfaef5fb062eda3bca87392a10f2d233bd2b56b4f71baf92e1"} Jul 17 22:10:07.663525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.663486 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" Jul 17 22:10:07.692553 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.692446 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-547b9cd8f5-qwb7x" podStartSLOduration=4.072099477 podStartE2EDuration="10.69242358s" totalImagesPullingTime="6.620324103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:07.692416572 +0000 UTC m=+79.850605276" watchObservedRunningTime="2026-07-17 22:10:07.69242358 +0000 UTC m=+79.850612282" Jul 17 22:10:07.692749 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.692641 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55d5884786-6scxk" podStartSLOduration=4.118455734 podStartE2EDuration="10.692628538s" totalImagesPullingTime="6.574172804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:07.67773953 +0000 UTC m=+79.835928253" watchObservedRunningTime="2026-07-17 22:10:07.692628538 +0000 UTC m=+79.850817243" Jul 17 22:10:07.754717 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:07.754596 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:08.002059 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:08.001935 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:08.071280 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:08.071190 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:08.223408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:08.223304 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:08.312255 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:08.312165 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:10:08.312255 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:08.312234 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:10:08.313633 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:08.313499 2556 patch_prober.go:28] interesting pod/console-55d5884786-6scxk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jul 17 22:10:08.313633 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:08.313558 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-55d5884786-6scxk" podUID="11a96acc-e265-4e06-9b18-580f90a87273" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jul 17 22:10:09.731106 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:09.731060 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:09.830004 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:09.829971 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:10.946138 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:10.945971 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:11.002632 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:11.002601 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:11.604573 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:11.604525 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:11.638518 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:11.638482 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-46h6v" Jul 17 22:10:11.965834 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:11.965767 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:12.066044 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:12.066013 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:12.121249 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:12.121220 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:13.145859 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.145793 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:13.359126 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.359092 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:13.422393 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.422293 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m5fgw"] Jul 17 22:10:13.426227 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.426201 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.429248 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.429218 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 22:10:13.429596 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.429564 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 22:10:13.430568 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.430545 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 22:10:13.430660 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.430598 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-59nfq\"" Jul 17 22:10:13.430660 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.430609 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 22:10:13.459120 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.459093 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:13.554499 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-textfile\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.554689 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6pw9\" (UniqueName: \"kubernetes.io/projected/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-kube-api-access-d6pw9\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.554689 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-wtmp\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.554689 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554672 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.554949 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-metrics-client-ca\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.554949 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-tls\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.554949 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-root\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.554949 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554900 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.554949 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.554942 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-sys\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.601217 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.601173 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:13.655388 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655350 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-root\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655572 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655572 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-sys\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655572 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655466 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-root\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655572 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655490 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-textfile\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655572 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6pw9\" (UniqueName: \"kubernetes.io/projected/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-kube-api-access-d6pw9\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-wtmp\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655599 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-sys\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655693 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-metrics-client-ca\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655703 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-wtmp\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.655835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655735 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-tls\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.656190 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.655916 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-textfile\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.656190 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.656130 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.656295 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.656244 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-metrics-client-ca\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.658637 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.658608 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.658792 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.658767 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-node-exporter-tls\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.663941 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.663916 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6pw9\" (UniqueName: \"kubernetes.io/projected/c4723a6b-1ba6-4cf4-83c1-11f245d3811d-kube-api-access-d6pw9\") pod \"node-exporter-m5fgw\" (UID: \"c4723a6b-1ba6-4cf4-83c1-11f245d3811d\") " pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.701474 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.701432 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:13.738433 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.738313 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m5fgw" Jul 17 22:10:13.801952 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.801923 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:13.860030 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:13.859996 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:14.382600 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:14.382557 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:14.471800 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:14.471763 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:14.594899 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:14.594854 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:14.694980 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:14.694953 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:15.829494 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:15.829456 2556 patch_prober.go:28] interesting pod/image-registry-6f8988cdf5-npmb7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 17 22:10:15.829932 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:15.829509 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" podUID="c08f5b67-bb9a-4585-b4d7-ffe841ce6826" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 22:10:16.318764 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:16.318729 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:16.419229 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:16.419188 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:16.523573 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:16.523540 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:16.584427 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:16.584327 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:17.347346 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:17.347301 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:17.402040 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:17.401988 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:17.592195 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:17.592164 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:10:17.763242 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:17.763208 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:17.845965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:17.845937 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:17.953324 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:17.953287 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:18.059090 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:18.059007 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:18.177705 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:18.177677 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:18.279556 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:18.279517 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:18.317682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:18.317600 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:10:18.322442 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:18.322413 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:10:18.390517 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:18.390469 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:19.650124 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:19.650075 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:19.967102 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:19.967073 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:20.028810 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.028774 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:20.280057 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.279922 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f8988cdf5-npmb7"] Jul 17 22:10:20.364280 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.364248 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:20.397305 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:10:20.397276 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4723a6b_1ba6_4cf4_83c1_11f245d3811d.slice/crio-e915bdb135e8f98bc38b7d97dd228b98c4fd4e9e585a79b3cd4e770a6428f0e5 WatchSource:0}: Error finding container e915bdb135e8f98bc38b7d97dd228b98c4fd4e9e585a79b3cd4e770a6428f0e5: Status 404 returned error can't find the container with id e915bdb135e8f98bc38b7d97dd228b98c4fd4e9e585a79b3cd4e770a6428f0e5 Jul 17 22:10:20.465285 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.465255 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:20.723242 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.723210 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5fgw" event={"ID":"c4723a6b-1ba6-4cf4-83c1-11f245d3811d","Type":"ContainerStarted","Data":"e915bdb135e8f98bc38b7d97dd228b98c4fd4e9e585a79b3cd4e770a6428f0e5"} Jul 17 22:10:20.724479 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.724453 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-q9656" event={"ID":"6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4","Type":"ContainerStarted","Data":"28860d4f540bb11917c87bed185a874f6c613d6e5552fe105d24e21484a4d90d"} Jul 17 22:10:20.724672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.724654 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-q9656" Jul 17 22:10:20.726038 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.726016 2556 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-q9656 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" start-of-body= Jul 17 22:10:20.726120 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.726060 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-q9656" podUID="6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" Jul 17 22:10:20.741386 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.741321 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-q9656" podStartSLOduration=3.85153397 podStartE2EDuration="23.741306743s" totalImagesPullingTime="19.889772773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:20.740184333 +0000 UTC m=+92.898373038" watchObservedRunningTime="2026-07-17 22:10:20.741306743 +0000 UTC m=+92.899495507" Jul 17 22:10:20.753691 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.753659 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:20.854831 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:20.854777 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:21.732493 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:21.732443 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9cwt7" event={"ID":"d135016a-fb35-4b02-8cf6-e99c32b83ce9","Type":"ContainerStarted","Data":"cfe1ab4e353d71b0cb39c52876a4d209d1d7d958a13d262261421690f91e724d"} Jul 17 22:10:21.748317 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:21.748286 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-q9656" Jul 17 22:10:22.740027 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:22.739984 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5fgw" event={"ID":"c4723a6b-1ba6-4cf4-83c1-11f245d3811d","Type":"ContainerStarted","Data":"0a00a253c98b2a147efed7371c4bd548926511c31707d5464e705f80fcfa7299"} Jul 17 22:10:23.801277 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:23.801224 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:23.870802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:23.870749 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:23.933111 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:23.933070 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:24.755526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:24.755483 2556 generic.go:356] "Generic (PLEG): container finished" podID="c4723a6b-1ba6-4cf4-83c1-11f245d3811d" containerID="0a00a253c98b2a147efed7371c4bd548926511c31707d5464e705f80fcfa7299" exitCode=0 Jul 17 22:10:24.755526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:24.755523 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5fgw" event={"ID":"c4723a6b-1ba6-4cf4-83c1-11f245d3811d","Type":"ContainerDied","Data":"0a00a253c98b2a147efed7371c4bd548926511c31707d5464e705f80fcfa7299"} Jul 17 22:10:25.762891 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:25.762842 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5fgw" event={"ID":"c4723a6b-1ba6-4cf4-83c1-11f245d3811d","Type":"ContainerStarted","Data":"bdbbe10db9c1597b3036551cdb963583fc493e38db7f9fb0ae5bfdccafd9d21a"} Jul 17 22:10:26.583905 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:26.583858 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gdhb8" Jul 17 22:10:26.770416 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:26.770375 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9cwt7" event={"ID":"d135016a-fb35-4b02-8cf6-e99c32b83ce9","Type":"ContainerStarted","Data":"04b78ddc3e932d8745520d47e746a37a3ffd40454922e15afe8c4f84ea268980"} Jul 17 22:10:26.773839 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:26.773807 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5fgw" event={"ID":"c4723a6b-1ba6-4cf4-83c1-11f245d3811d","Type":"ContainerStarted","Data":"c34e53e3779106bdf3e3c869166191c90313c9cc27a3c246639169634361d68f"} Jul 17 22:10:26.793406 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:26.792974 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m5fgw" podStartSLOduration=11.596109063 podStartE2EDuration="13.792949191s" totalImagesPullingTime="2.084393327s" totalInitContainerRuntime="112.446801ms" isStatefulPod=true podCreationTimestamp="2026-07-17 22:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:26.790955277 +0000 UTC m=+98.949143999" watchObservedRunningTime="2026-07-17 22:10:26.792949191 +0000 UTC m=+98.951137891" Jul 17 22:10:27.120969 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:27.120898 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:27.221977 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:27.221909 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:29.766790 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:29.766756 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:29.867472 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:29.867434 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:30.953908 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:30.953866 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55d5884786-6scxk"] Jul 17 22:10:31.103563 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:31.103484 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:31.194684 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:31.194647 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:31.294790 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:31.294757 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:31.395699 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:31.395619 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:31.800996 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:31.800956 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9cwt7" event={"ID":"d135016a-fb35-4b02-8cf6-e99c32b83ce9","Type":"ContainerStarted","Data":"725dbeb6bda179679582a42b2b40093d08c94c544bec3ad22ea18386ce8d3057"} Jul 17 22:10:31.818884 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:31.818837 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9cwt7" podStartSLOduration=35.604289765 podStartE2EDuration="58.818822176s" totalImagesPullingTime="23.214532411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:09:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:10:31.81684382 +0000 UTC m=+103.975032524" watchObservedRunningTime="2026-07-17 22:10:31.818822176 +0000 UTC m=+103.977010879" Jul 17 22:10:32.945968 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:32.945933 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:33.046047 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:33.046014 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:34.369269 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:34.369236 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:34.470610 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:34.470575 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:42.842971 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:42.842884 2556 generic.go:356] "Generic (PLEG): container finished" podID="82a8fba8-65a4-4b5a-9fc2-8af1587fe43c" containerID="6e0765a002e4866db095e62b2214df1c7870fde71a20191f462472483a9d74f2" exitCode=0 Jul 17 22:10:42.842971 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:42.842957 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" event={"ID":"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c","Type":"ContainerDied","Data":"6e0765a002e4866db095e62b2214df1c7870fde71a20191f462472483a9d74f2"} Jul 17 22:10:42.843422 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:42.843270 2556 scope.go:117] "RemoveContainer" containerID="6e0765a002e4866db095e62b2214df1c7870fde71a20191f462472483a9d74f2" Jul 17 22:10:43.847711 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:43.847678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-fm2jc" event={"ID":"82a8fba8-65a4-4b5a-9fc2-8af1587fe43c","Type":"ContainerStarted","Data":"d119151866d95290b043bcf09cc475ba0586678f70cc36dd2d1aef5ae2adfec1"} Jul 17 22:10:43.849084 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:43.849061 2556 generic.go:356] "Generic (PLEG): container finished" podID="9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6" containerID="2056e00a8624976ea186d4b62057ba738444d2668947b818fc218b1bd2740bed" exitCode=0 Jul 17 22:10:43.849184 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:43.849106 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" event={"ID":"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6","Type":"ContainerDied","Data":"2056e00a8624976ea186d4b62057ba738444d2668947b818fc218b1bd2740bed"} Jul 17 22:10:43.849396 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:43.849383 2556 scope.go:117] "RemoveContainer" containerID="2056e00a8624976ea186d4b62057ba738444d2668947b818fc218b1bd2740bed" Jul 17 22:10:44.854080 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:44.854046 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ttzsn" event={"ID":"9bcd820c-78b3-46a1-b833-dc6b5e3fbdc6","Type":"ContainerStarted","Data":"e5b031830fd2662a20f62235a2f5736d1a4fbcdac28c84ef8cc9f7fa16c53815"} Jul 17 22:10:45.306793 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.306746 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" podUID="c08f5b67-bb9a-4585-b4d7-ffe841ce6826" containerName="registry" containerID="cri-o://56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848" gracePeriod=30 Jul 17 22:10:45.604871 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.604843 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:10:45.730132 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730094 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-certificates\") pod \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " Jul 17 22:10:45.730132 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730135 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") pod \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " Jul 17 22:10:45.730408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730178 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-bound-sa-token\") pod \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " Jul 17 22:10:45.730408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730206 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-installation-pull-secrets\") pod \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " Jul 17 22:10:45.730408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730229 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-trusted-ca\") pod \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " Jul 17 22:10:45.730408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730245 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnzzt\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-kube-api-access-rnzzt\") pod \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " Jul 17 22:10:45.730408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730277 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-ca-trust-extracted\") pod \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " Jul 17 22:10:45.730408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730322 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-image-registry-private-configuration\") pod \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\" (UID: \"c08f5b67-bb9a-4585-b4d7-ffe841ce6826\") " Jul 17 22:10:45.730743 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730712 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c08f5b67-bb9a-4585-b4d7-ffe841ce6826" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:10:45.731010 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.730976 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c08f5b67-bb9a-4585-b4d7-ffe841ce6826" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:10:45.733157 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.733125 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c08f5b67-bb9a-4585-b4d7-ffe841ce6826" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:10:45.733251 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.733206 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-kube-api-access-rnzzt" (OuterVolumeSpecName: "kube-api-access-rnzzt") pod "c08f5b67-bb9a-4585-b4d7-ffe841ce6826" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826"). InnerVolumeSpecName "kube-api-access-rnzzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:10:45.733312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.733262 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c08f5b67-bb9a-4585-b4d7-ffe841ce6826" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:10:45.733312 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.733289 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c08f5b67-bb9a-4585-b4d7-ffe841ce6826" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:10:45.733413 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.733374 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c08f5b67-bb9a-4585-b4d7-ffe841ce6826" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:10:45.741100 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.741073 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c08f5b67-bb9a-4585-b4d7-ffe841ce6826" (UID: "c08f5b67-bb9a-4585-b4d7-ffe841ce6826"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:10:45.831189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.831116 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-image-registry-private-configuration\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:45.831189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.831145 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-certificates\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:45.831189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.831156 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-registry-tls\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:45.831189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.831165 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-bound-sa-token\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:45.831189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.831174 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-installation-pull-secrets\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:45.831189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.831182 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-trusted-ca\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:45.831189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.831190 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnzzt\" (UniqueName: \"kubernetes.io/projected/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-kube-api-access-rnzzt\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:45.831512 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.831198 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c08f5b67-bb9a-4585-b4d7-ffe841ce6826-ca-trust-extracted\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:45.859252 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.859218 2556 generic.go:356] "Generic (PLEG): container finished" podID="c08f5b67-bb9a-4585-b4d7-ffe841ce6826" containerID="56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848" exitCode=0 Jul 17 22:10:45.859639 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.859262 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" Jul 17 22:10:45.859639 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.859276 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" event={"ID":"c08f5b67-bb9a-4585-b4d7-ffe841ce6826","Type":"ContainerDied","Data":"56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848"} Jul 17 22:10:45.859639 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.859325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8988cdf5-npmb7" event={"ID":"c08f5b67-bb9a-4585-b4d7-ffe841ce6826","Type":"ContainerDied","Data":"4c5a65a9017e9a4e36ea8a78ef7c776bff13cdd6387f9b8974d983e658936a84"} Jul 17 22:10:45.859639 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.859363 2556 scope.go:117] "RemoveContainer" containerID="56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848" Jul 17 22:10:45.868715 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.868694 2556 scope.go:117] "RemoveContainer" containerID="56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848" Jul 17 22:10:45.868979 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:10:45.868950 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848\": container with ID starting with 56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848 not found: ID does not exist" containerID="56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848" Jul 17 22:10:45.869039 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.868985 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848"} err="failed to get container status \"56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848\": rpc error: code = NotFound desc = could not find container \"56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848\": container with ID starting with 56876192013ce6b1ad97cd88e82c557eb801c016ddf739106e1efcc08ff8d848 not found: ID does not exist" Jul 17 22:10:45.881700 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.881680 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f8988cdf5-npmb7"] Jul 17 22:10:45.887092 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:45.887071 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f8988cdf5-npmb7"] Jul 17 22:10:47.229481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:47.229453 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c08f5b67-bb9a-4585-b4d7-ffe841ce6826" path="/var/lib/kubelet/pods/c08f5b67-bb9a-4585-b4d7-ffe841ce6826/volumes" Jul 17 22:10:48.871672 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:48.871638 2556 generic.go:356] "Generic (PLEG): container finished" podID="b36c8f1e-c34e-4d9a-8f95-7b83e8390082" containerID="d81a9034ffb02bbcff3042c32bb17a30056e9cd471d7dd16811f9e35fbac55ec" exitCode=0 Jul 17 22:10:48.872124 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:48.871710 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-t4vf2" event={"ID":"b36c8f1e-c34e-4d9a-8f95-7b83e8390082","Type":"ContainerDied","Data":"d81a9034ffb02bbcff3042c32bb17a30056e9cd471d7dd16811f9e35fbac55ec"} Jul 17 22:10:48.872124 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:48.872065 2556 scope.go:117] "RemoveContainer" containerID="d81a9034ffb02bbcff3042c32bb17a30056e9cd471d7dd16811f9e35fbac55ec" Jul 17 22:10:49.877239 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:49.877208 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-t4vf2" event={"ID":"b36c8f1e-c34e-4d9a-8f95-7b83e8390082","Type":"ContainerStarted","Data":"e7b57fc0cafc75f6e541630298f8b4fc81a01a39c3931b068aef3263b02cd235"} Jul 17 22:10:51.693035 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:51.692998 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:51.789178 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:51.789138 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:10:55.975719 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:55.975675 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55d5884786-6scxk" podUID="11a96acc-e265-4e06-9b18-580f90a87273" containerName="console" containerID="cri-o://e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88" gracePeriod=15 Jul 17 22:10:56.260831 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.260800 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:10:56.416119 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416081 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd6nm\" (UniqueName: \"kubernetes.io/projected/11a96acc-e265-4e06-9b18-580f90a87273-kube-api-access-hd6nm\") pod \"11a96acc-e265-4e06-9b18-580f90a87273\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " Jul 17 22:10:56.416293 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416130 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-console-config\") pod \"11a96acc-e265-4e06-9b18-580f90a87273\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " Jul 17 22:10:56.416293 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416176 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-oauth-config\") pod \"11a96acc-e265-4e06-9b18-580f90a87273\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " Jul 17 22:10:56.416293 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416192 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-serving-cert\") pod \"11a96acc-e265-4e06-9b18-580f90a87273\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " Jul 17 22:10:56.416293 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416222 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-service-ca\") pod \"11a96acc-e265-4e06-9b18-580f90a87273\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " Jul 17 22:10:56.416293 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416270 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-oauth-serving-cert\") pod \"11a96acc-e265-4e06-9b18-580f90a87273\" (UID: \"11a96acc-e265-4e06-9b18-580f90a87273\") " Jul 17 22:10:56.416656 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416629 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-service-ca" (OuterVolumeSpecName: "service-ca") pod "11a96acc-e265-4e06-9b18-580f90a87273" (UID: "11a96acc-e265-4e06-9b18-580f90a87273"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:10:56.416713 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416652 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-console-config" (OuterVolumeSpecName: "console-config") pod "11a96acc-e265-4e06-9b18-580f90a87273" (UID: "11a96acc-e265-4e06-9b18-580f90a87273"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:10:56.416713 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.416676 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11a96acc-e265-4e06-9b18-580f90a87273" (UID: "11a96acc-e265-4e06-9b18-580f90a87273"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:10:56.418663 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.418637 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11a96acc-e265-4e06-9b18-580f90a87273" (UID: "11a96acc-e265-4e06-9b18-580f90a87273"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:10:56.418810 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.418692 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a96acc-e265-4e06-9b18-580f90a87273-kube-api-access-hd6nm" (OuterVolumeSpecName: "kube-api-access-hd6nm") pod "11a96acc-e265-4e06-9b18-580f90a87273" (UID: "11a96acc-e265-4e06-9b18-580f90a87273"). InnerVolumeSpecName "kube-api-access-hd6nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:10:56.418810 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.418711 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11a96acc-e265-4e06-9b18-580f90a87273" (UID: "11a96acc-e265-4e06-9b18-580f90a87273"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:10:56.517419 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.517327 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-service-ca\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:56.517419 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.517376 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-oauth-serving-cert\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:56.517419 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.517386 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd6nm\" (UniqueName: \"kubernetes.io/projected/11a96acc-e265-4e06-9b18-580f90a87273-kube-api-access-hd6nm\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:56.517419 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.517395 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11a96acc-e265-4e06-9b18-580f90a87273-console-config\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:56.517419 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.517403 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-oauth-config\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:56.517419 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.517412 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a96acc-e265-4e06-9b18-580f90a87273-console-serving-cert\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:10:56.903618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.903529 2556 generic.go:356] "Generic (PLEG): container finished" podID="11a96acc-e265-4e06-9b18-580f90a87273" containerID="e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88" exitCode=0 Jul 17 22:10:56.903618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.903574 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5884786-6scxk" Jul 17 22:10:56.903813 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.903613 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5884786-6scxk" event={"ID":"11a96acc-e265-4e06-9b18-580f90a87273","Type":"ContainerDied","Data":"e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88"} Jul 17 22:10:56.903813 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.903664 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5884786-6scxk" event={"ID":"11a96acc-e265-4e06-9b18-580f90a87273","Type":"ContainerDied","Data":"cbc1b453913b96d48bbf2247c85c89cc47ebfc77adfbf96db5369959242ee9db"} Jul 17 22:10:56.903813 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.903692 2556 scope.go:117] "RemoveContainer" containerID="e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88" Jul 17 22:10:56.912249 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.912230 2556 scope.go:117] "RemoveContainer" containerID="e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88" Jul 17 22:10:56.912502 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:10:56.912484 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88\": container with ID starting with e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88 not found: ID does not exist" containerID="e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88" Jul 17 22:10:56.912560 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.912510 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88"} err="failed to get container status \"e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88\": rpc error: code = NotFound desc = could not find container \"e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88\": container with ID starting with e09403e531ff506c29e1927351f1de0fa20c4c30c2e75b2511b3448a5d6fff88 not found: ID does not exist" Jul 17 22:10:56.925564 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.924653 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55d5884786-6scxk"] Jul 17 22:10:56.929797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:56.929773 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55d5884786-6scxk"] Jul 17 22:10:57.228770 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:10:57.228724 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11a96acc-e265-4e06-9b18-580f90a87273" path="/var/lib/kubelet/pods/11a96acc-e265-4e06-9b18-580f90a87273/volumes" Jul 17 22:11:04.375082 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:04.375044 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:04.431761 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:04.431705 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:32.589829 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:32.589793 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:33.273435 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:33.273405 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:41.997504 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:41.997428 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c566b668-s8h8x"] Jul 17 22:11:41.997951 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:41.997712 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08f5b67-bb9a-4585-b4d7-ffe841ce6826" containerName="registry" Jul 17 22:11:41.997951 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:41.997724 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08f5b67-bb9a-4585-b4d7-ffe841ce6826" containerName="registry" Jul 17 22:11:41.997951 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:41.997748 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a96acc-e265-4e06-9b18-580f90a87273" containerName="console" Jul 17 22:11:41.997951 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:41.997754 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a96acc-e265-4e06-9b18-580f90a87273" containerName="console" Jul 17 22:11:41.997951 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:41.997798 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a96acc-e265-4e06-9b18-580f90a87273" containerName="console" Jul 17 22:11:41.997951 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:41.997805 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08f5b67-bb9a-4585-b4d7-ffe841ce6826" containerName="registry" Jul 17 22:11:41.999746 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:41.999714 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.002433 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.002408 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 22:11:42.003988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.003963 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 22:11:42.004104 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.003969 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-srgm9\"" Jul 17 22:11:42.004173 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.004106 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 22:11:42.004220 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.004170 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 22:11:42.004220 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.004198 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 22:11:42.008705 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.008683 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 22:11:42.012880 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.012853 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c566b668-s8h8x"] Jul 17 22:11:42.053388 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.053356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-oauth-config\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.053526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.053406 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-console-config\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.053526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.053448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-serving-cert\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.053526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.053482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-service-ca\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.053526 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.053499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-oauth-serving-cert\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.053657 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.053530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s5qq\" (UniqueName: \"kubernetes.io/projected/b6890244-5edd-4672-a402-bdd772b51e1c-kube-api-access-6s5qq\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.053657 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.053579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-trusted-ca-bundle\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.141658 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.141593 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:42.154783 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.154763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s5qq\" (UniqueName: \"kubernetes.io/projected/b6890244-5edd-4672-a402-bdd772b51e1c-kube-api-access-6s5qq\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.154857 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.154792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-trusted-ca-bundle\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.154857 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.154816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-oauth-config\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.154857 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.154837 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-console-config\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.154975 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.154866 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-serving-cert\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.154975 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.154889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-service-ca\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.154975 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.154905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-oauth-serving-cert\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.155754 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.155723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-service-ca\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.155880 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.155763 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-console-config\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.155880 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.155778 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-oauth-serving-cert\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.155880 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.155764 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-trusted-ca-bundle\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.157305 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.157288 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-oauth-config\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.157569 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.157540 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-serving-cert\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.163955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.163929 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s5qq\" (UniqueName: \"kubernetes.io/projected/b6890244-5edd-4672-a402-bdd772b51e1c-kube-api-access-6s5qq\") pod \"console-64c566b668-s8h8x\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.196752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.196721 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:42.309831 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.309759 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:42.438394 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:42.438367 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c566b668-s8h8x"] Jul 17 22:11:42.441035 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:11:42.441007 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6890244_5edd_4672_a402_bdd772b51e1c.slice/crio-d3d6f07503c68746f1ed26df549ff0edab7c39c6121b4c1a5156aa86482689a1 WatchSource:0}: Error finding container d3d6f07503c68746f1ed26df549ff0edab7c39c6121b4c1a5156aa86482689a1: Status 404 returned error can't find the container with id d3d6f07503c68746f1ed26df549ff0edab7c39c6121b4c1a5156aa86482689a1 Jul 17 22:11:43.074108 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:43.074071 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c566b668-s8h8x" event={"ID":"b6890244-5edd-4672-a402-bdd772b51e1c","Type":"ContainerStarted","Data":"fa684973832554cb60f60be20c36b3856dd092fcc06beb37693b7e43b693ea33"} Jul 17 22:11:43.074525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:43.074130 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c566b668-s8h8x" event={"ID":"b6890244-5edd-4672-a402-bdd772b51e1c","Type":"ContainerStarted","Data":"d3d6f07503c68746f1ed26df549ff0edab7c39c6121b4c1a5156aa86482689a1"} Jul 17 22:11:43.096541 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:43.096488 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c566b668-s8h8x" podStartSLOduration=2.09647176 podStartE2EDuration="2.09647176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:11:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:11:43.095761262 +0000 UTC m=+175.253949967" watchObservedRunningTime="2026-07-17 22:11:43.09647176 +0000 UTC m=+175.254660513" Jul 17 22:11:47.815058 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:47.815022 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:47.865977 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:47.865941 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:47.953847 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:47.953815 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:49.052147 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.052112 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c566b668-s8h8x"] Jul 17 22:11:49.078544 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.078510 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64fcb5496b-d45w8"] Jul 17 22:11:49.081317 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.081295 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.091994 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.091972 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64fcb5496b-d45w8"] Jul 17 22:11:49.208966 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.208934 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-trusted-ca-bundle\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.209163 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.208974 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-serving-cert\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.209163 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.208998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckj2z\" (UniqueName: \"kubernetes.io/projected/2b3bb769-80a3-4c79-b248-212572687494-kube-api-access-ckj2z\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.209163 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.209097 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-console-config\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.209305 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.209167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-service-ca\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.209305 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.209195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-oauth-config\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.209305 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.209235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-oauth-serving-cert\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.310296 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.310197 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-console-config\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.310296 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.310248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-service-ca\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.310296 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.310269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-oauth-config\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.310599 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.310304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-oauth-serving-cert\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.310599 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.310365 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-trusted-ca-bundle\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.310599 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.310398 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-serving-cert\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.310599 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.310428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckj2z\" (UniqueName: \"kubernetes.io/projected/2b3bb769-80a3-4c79-b248-212572687494-kube-api-access-ckj2z\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.311097 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.311069 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-console-config\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.311197 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.311140 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-oauth-serving-cert\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.311197 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.311149 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-service-ca\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.311447 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.311422 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-trusted-ca-bundle\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.312901 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.312850 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-oauth-config\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.312992 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.312945 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-serving-cert\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.319604 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.319585 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckj2z\" (UniqueName: \"kubernetes.io/projected/2b3bb769-80a3-4c79-b248-212572687494-kube-api-access-ckj2z\") pod \"console-64fcb5496b-d45w8\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.390524 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.390490 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:49.518780 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:49.518748 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64fcb5496b-d45w8"] Jul 17 22:11:49.521283 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:11:49.521257 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3bb769_80a3_4c79_b248_212572687494.slice/crio-183793fc341ef56de413150835c53dd89bc0d8cc436c73e671f74a0113f7b0ba WatchSource:0}: Error finding container 183793fc341ef56de413150835c53dd89bc0d8cc436c73e671f74a0113f7b0ba: Status 404 returned error can't find the container with id 183793fc341ef56de413150835c53dd89bc0d8cc436c73e671f74a0113f7b0ba Jul 17 22:11:50.104399 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:50.104360 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fcb5496b-d45w8" event={"ID":"2b3bb769-80a3-4c79-b248-212572687494","Type":"ContainerStarted","Data":"276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8"} Jul 17 22:11:50.104786 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:50.104426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fcb5496b-d45w8" event={"ID":"2b3bb769-80a3-4c79-b248-212572687494","Type":"ContainerStarted","Data":"183793fc341ef56de413150835c53dd89bc0d8cc436c73e671f74a0113f7b0ba"} Jul 17 22:11:50.123431 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:50.123385 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64fcb5496b-d45w8" podStartSLOduration=1.123370382 podStartE2EDuration="1.123370382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:11:50.122145709 +0000 UTC m=+182.280334413" watchObservedRunningTime="2026-07-17 22:11:50.123370382 +0000 UTC m=+182.281559086" Jul 17 22:11:52.309973 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:52.309935 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:11:59.391021 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:59.390980 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:59.391505 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:59.391043 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:59.396725 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:59.396696 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:11:59.818687 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:59.818655 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:11:59.871434 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:11:59.871401 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:00.144362 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:00.144270 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:12:00.295827 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:00.295792 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:00.399623 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:00.399523 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:00.500798 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:00.500767 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:04.380776 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:04.380740 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:04.482645 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:04.482612 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:14.071861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.071795 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64c566b668-s8h8x" podUID="b6890244-5edd-4672-a402-bdd772b51e1c" containerName="console" containerID="cri-o://fa684973832554cb60f60be20c36b3856dd092fcc06beb37693b7e43b693ea33" gracePeriod=15 Jul 17 22:12:14.193518 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.193482 2556 generic.go:356] "Generic (PLEG): container finished" podID="b6890244-5edd-4672-a402-bdd772b51e1c" containerID="fa684973832554cb60f60be20c36b3856dd092fcc06beb37693b7e43b693ea33" exitCode=0 Jul 17 22:12:14.193646 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.193544 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c566b668-s8h8x" event={"ID":"b6890244-5edd-4672-a402-bdd772b51e1c","Type":"ContainerDied","Data":"fa684973832554cb60f60be20c36b3856dd092fcc06beb37693b7e43b693ea33"} Jul 17 22:12:14.324881 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.324831 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:12:14.415616 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.415588 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-serving-cert\") pod \"b6890244-5edd-4672-a402-bdd772b51e1c\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " Jul 17 22:12:14.415616 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.415621 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-oauth-config\") pod \"b6890244-5edd-4672-a402-bdd772b51e1c\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " Jul 17 22:12:14.415858 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.415693 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-trusted-ca-bundle\") pod \"b6890244-5edd-4672-a402-bdd772b51e1c\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " Jul 17 22:12:14.415858 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.415720 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-console-config\") pod \"b6890244-5edd-4672-a402-bdd772b51e1c\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " Jul 17 22:12:14.415858 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.415740 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-oauth-serving-cert\") pod \"b6890244-5edd-4672-a402-bdd772b51e1c\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " Jul 17 22:12:14.415858 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.415776 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-service-ca\") pod \"b6890244-5edd-4672-a402-bdd772b51e1c\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " Jul 17 22:12:14.416046 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.415856 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s5qq\" (UniqueName: \"kubernetes.io/projected/b6890244-5edd-4672-a402-bdd772b51e1c-kube-api-access-6s5qq\") pod \"b6890244-5edd-4672-a402-bdd772b51e1c\" (UID: \"b6890244-5edd-4672-a402-bdd772b51e1c\") " Jul 17 22:12:14.416171 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.416148 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6890244-5edd-4672-a402-bdd772b51e1c" (UID: "b6890244-5edd-4672-a402-bdd772b51e1c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:12:14.416229 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.416171 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6890244-5edd-4672-a402-bdd772b51e1c" (UID: "b6890244-5edd-4672-a402-bdd772b51e1c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:12:14.416229 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.416167 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-console-config" (OuterVolumeSpecName: "console-config") pod "b6890244-5edd-4672-a402-bdd772b51e1c" (UID: "b6890244-5edd-4672-a402-bdd772b51e1c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:12:14.416229 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.416180 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6890244-5edd-4672-a402-bdd772b51e1c" (UID: "b6890244-5edd-4672-a402-bdd772b51e1c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:12:14.417861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.417837 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6890244-5edd-4672-a402-bdd772b51e1c" (UID: "b6890244-5edd-4672-a402-bdd772b51e1c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:12:14.417968 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.417862 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6890244-5edd-4672-a402-bdd772b51e1c" (UID: "b6890244-5edd-4672-a402-bdd772b51e1c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:12:14.417968 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.417955 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6890244-5edd-4672-a402-bdd772b51e1c-kube-api-access-6s5qq" (OuterVolumeSpecName: "kube-api-access-6s5qq") pod "b6890244-5edd-4672-a402-bdd772b51e1c" (UID: "b6890244-5edd-4672-a402-bdd772b51e1c"). InnerVolumeSpecName "kube-api-access-6s5qq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:12:14.517321 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.517276 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-trusted-ca-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:14.517321 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.517310 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-console-config\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:14.517321 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.517324 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-oauth-serving-cert\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:14.517585 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.517360 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6890244-5edd-4672-a402-bdd772b51e1c-service-ca\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:14.517585 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.517373 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s5qq\" (UniqueName: \"kubernetes.io/projected/b6890244-5edd-4672-a402-bdd772b51e1c-kube-api-access-6s5qq\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:14.517585 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.517384 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-serving-cert\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:14.517585 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:14.517396 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6890244-5edd-4672-a402-bdd772b51e1c-console-oauth-config\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:15.198744 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:15.198707 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c566b668-s8h8x" event={"ID":"b6890244-5edd-4672-a402-bdd772b51e1c","Type":"ContainerDied","Data":"d3d6f07503c68746f1ed26df549ff0edab7c39c6121b4c1a5156aa86482689a1"} Jul 17 22:12:15.198744 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:15.198727 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c566b668-s8h8x" Jul 17 22:12:15.199255 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:15.198774 2556 scope.go:117] "RemoveContainer" containerID="fa684973832554cb60f60be20c36b3856dd092fcc06beb37693b7e43b693ea33" Jul 17 22:12:15.219670 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:15.219645 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c566b668-s8h8x"] Jul 17 22:12:15.221698 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:15.221673 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c566b668-s8h8x"] Jul 17 22:12:15.228536 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:15.228512 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6890244-5edd-4672-a402-bdd772b51e1c" path="/var/lib/kubelet/pods/b6890244-5edd-4672-a402-bdd772b51e1c/volumes" Jul 17 22:12:20.133071 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:20.133030 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:20.190031 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:20.189977 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:28.955436 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:28.955404 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:37.704116 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:37.704076 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:37.802576 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:37.802542 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:38.287955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.287910 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck"] Jul 17 22:12:38.288219 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.288207 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6890244-5edd-4672-a402-bdd772b51e1c" containerName="console" Jul 17 22:12:38.288266 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.288220 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6890244-5edd-4672-a402-bdd772b51e1c" containerName="console" Jul 17 22:12:38.288302 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.288275 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6890244-5edd-4672-a402-bdd772b51e1c" containerName="console" Jul 17 22:12:38.291146 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.291130 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.294165 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.294142 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 22:12:38.294284 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.294213 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 22:12:38.297224 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.297205 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bmfgp\"" Jul 17 22:12:38.300863 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.300840 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck"] Jul 17 22:12:38.395009 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.394964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.395246 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.395022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtt46\" (UniqueName: \"kubernetes.io/projected/6f215bf4-4132-4537-b666-dee7a4d59193-kube-api-access-gtt46\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.395246 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.395132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.495932 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.495877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.495932 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.495942 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.496177 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.495977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtt46\" (UniqueName: \"kubernetes.io/projected/6f215bf4-4132-4537-b666-dee7a4d59193-kube-api-access-gtt46\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.496295 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.496270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.496378 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.496300 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.504385 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.504353 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtt46\" (UniqueName: \"kubernetes.io/projected/6f215bf4-4132-4537-b666-dee7a4d59193-kube-api-access-gtt46\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.602259 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.602164 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:38.728185 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:38.728147 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck"] Jul 17 22:12:38.735144 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:12:38.735111 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f215bf4_4132_4537_b666_dee7a4d59193.slice/crio-446f2759e9e4ccaeac4b1cf38e1ba13acdfb473fc32fa000fde978e8d1a8e0e5 WatchSource:0}: Error finding container 446f2759e9e4ccaeac4b1cf38e1ba13acdfb473fc32fa000fde978e8d1a8e0e5: Status 404 returned error can't find the container with id 446f2759e9e4ccaeac4b1cf38e1ba13acdfb473fc32fa000fde978e8d1a8e0e5 Jul 17 22:12:39.284774 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:39.284735 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" event={"ID":"6f215bf4-4132-4537-b666-dee7a4d59193","Type":"ContainerStarted","Data":"446f2759e9e4ccaeac4b1cf38e1ba13acdfb473fc32fa000fde978e8d1a8e0e5"} Jul 17 22:12:46.313868 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:46.313831 2556 generic.go:356] "Generic (PLEG): container finished" podID="6f215bf4-4132-4537-b666-dee7a4d59193" containerID="f794904321aa64406d9556d61271b111cfb9f631c989221cc953a6227ba9550b" exitCode=0 Jul 17 22:12:46.314285 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:46.313916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" event={"ID":"6f215bf4-4132-4537-b666-dee7a4d59193","Type":"ContainerDied","Data":"f794904321aa64406d9556d61271b111cfb9f631c989221cc953a6227ba9550b"} Jul 17 22:12:49.327492 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:49.327451 2556 generic.go:356] "Generic (PLEG): container finished" podID="6f215bf4-4132-4537-b666-dee7a4d59193" containerID="d4c6f3f9e2837509028ee0d74560b020e57dddcfc9f54a08b74c8c4553527c50" exitCode=0 Jul 17 22:12:49.327869 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:49.327538 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" event={"ID":"6f215bf4-4132-4537-b666-dee7a4d59193","Type":"ContainerDied","Data":"d4c6f3f9e2837509028ee0d74560b020e57dddcfc9f54a08b74c8c4553527c50"} Jul 17 22:12:52.424550 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:52.424509 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:52.521715 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:52.521680 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:12:57.360153 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:57.360116 2556 generic.go:356] "Generic (PLEG): container finished" podID="6f215bf4-4132-4537-b666-dee7a4d59193" containerID="1ffd39848dca867530b87e3be41425ec807da25478e22c91374cc1f5ade8cda1" exitCode=0 Jul 17 22:12:57.360565 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:57.360202 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" event={"ID":"6f215bf4-4132-4537-b666-dee7a4d59193","Type":"ContainerDied","Data":"1ffd39848dca867530b87e3be41425ec807da25478e22c91374cc1f5ade8cda1"} Jul 17 22:12:58.487099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.487072 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:58.570832 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.570797 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-util\") pod \"6f215bf4-4132-4537-b666-dee7a4d59193\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " Jul 17 22:12:58.571005 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.570841 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-bundle\") pod \"6f215bf4-4132-4537-b666-dee7a4d59193\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " Jul 17 22:12:58.571005 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.570872 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtt46\" (UniqueName: \"kubernetes.io/projected/6f215bf4-4132-4537-b666-dee7a4d59193-kube-api-access-gtt46\") pod \"6f215bf4-4132-4537-b666-dee7a4d59193\" (UID: \"6f215bf4-4132-4537-b666-dee7a4d59193\") " Jul 17 22:12:58.571503 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.571475 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-bundle" (OuterVolumeSpecName: "bundle") pod "6f215bf4-4132-4537-b666-dee7a4d59193" (UID: "6f215bf4-4132-4537-b666-dee7a4d59193"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:12:58.573113 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.573087 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f215bf4-4132-4537-b666-dee7a4d59193-kube-api-access-gtt46" (OuterVolumeSpecName: "kube-api-access-gtt46") pod "6f215bf4-4132-4537-b666-dee7a4d59193" (UID: "6f215bf4-4132-4537-b666-dee7a4d59193"). InnerVolumeSpecName "kube-api-access-gtt46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:12:58.575413 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.575391 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-util" (OuterVolumeSpecName: "util") pod "6f215bf4-4132-4537-b666-dee7a4d59193" (UID: "6f215bf4-4132-4537-b666-dee7a4d59193"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:12:58.671808 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.671728 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-util\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:58.671808 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.671758 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f215bf4-4132-4537-b666-dee7a4d59193-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:58.671808 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:58.671768 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtt46\" (UniqueName: \"kubernetes.io/projected/6f215bf4-4132-4537-b666-dee7a4d59193-kube-api-access-gtt46\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:12:59.368718 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:59.368682 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" Jul 17 22:12:59.368718 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:59.368697 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gzrck" event={"ID":"6f215bf4-4132-4537-b666-dee7a4d59193","Type":"ContainerDied","Data":"446f2759e9e4ccaeac4b1cf38e1ba13acdfb473fc32fa000fde978e8d1a8e0e5"} Jul 17 22:12:59.368915 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:12:59.368753 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="446f2759e9e4ccaeac4b1cf38e1ba13acdfb473fc32fa000fde978e8d1a8e0e5" Jul 17 22:13:04.338383 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:04.338348 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:05.239115 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:05.239085 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:06.291606 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.291572 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj"] Jul 17 22:13:06.291997 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.291846 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f215bf4-4132-4537-b666-dee7a4d59193" containerName="pull" Jul 17 22:13:06.291997 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.291857 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f215bf4-4132-4537-b666-dee7a4d59193" containerName="pull" Jul 17 22:13:06.291997 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.291872 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f215bf4-4132-4537-b666-dee7a4d59193" containerName="extract" Jul 17 22:13:06.291997 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.291878 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f215bf4-4132-4537-b666-dee7a4d59193" containerName="extract" Jul 17 22:13:06.291997 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.291888 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f215bf4-4132-4537-b666-dee7a4d59193" containerName="util" Jul 17 22:13:06.291997 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.291894 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f215bf4-4132-4537-b666-dee7a4d59193" containerName="util" Jul 17 22:13:06.291997 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.291937 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f215bf4-4132-4537-b666-dee7a4d59193" containerName="extract" Jul 17 22:13:06.295266 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.295247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" Jul 17 22:13:06.298055 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.298025 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:13:06.298179 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.298025 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 17 22:13:06.298179 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.298130 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wc8px\"" Jul 17 22:13:06.312429 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.312401 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj"] Jul 17 22:13:06.437880 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.437845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mjmt\" (UniqueName: \"kubernetes.io/projected/56b6ccbd-4772-46ed-94f2-7c834d77ff32-kube-api-access-8mjmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s6mj\" (UID: \"56b6ccbd-4772-46ed-94f2-7c834d77ff32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" Jul 17 22:13:06.438060 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.437913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56b6ccbd-4772-46ed-94f2-7c834d77ff32-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s6mj\" (UID: \"56b6ccbd-4772-46ed-94f2-7c834d77ff32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" Jul 17 22:13:06.538253 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.538214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mjmt\" (UniqueName: \"kubernetes.io/projected/56b6ccbd-4772-46ed-94f2-7c834d77ff32-kube-api-access-8mjmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s6mj\" (UID: \"56b6ccbd-4772-46ed-94f2-7c834d77ff32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" Jul 17 22:13:06.538435 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.538303 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56b6ccbd-4772-46ed-94f2-7c834d77ff32-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s6mj\" (UID: \"56b6ccbd-4772-46ed-94f2-7c834d77ff32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" Jul 17 22:13:06.538726 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.538708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56b6ccbd-4772-46ed-94f2-7c834d77ff32-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s6mj\" (UID: \"56b6ccbd-4772-46ed-94f2-7c834d77ff32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" Jul 17 22:13:06.552268 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.552205 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mjmt\" (UniqueName: \"kubernetes.io/projected/56b6ccbd-4772-46ed-94f2-7c834d77ff32-kube-api-access-8mjmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s6mj\" (UID: \"56b6ccbd-4772-46ed-94f2-7c834d77ff32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" Jul 17 22:13:06.604649 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.604615 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" Jul 17 22:13:06.736164 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:06.736136 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj"] Jul 17 22:13:06.738911 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:13:06.738880 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b6ccbd_4772_46ed_94f2_7c834d77ff32.slice/crio-02f7942a36038efd7589927d591c35bc47d745ee388eca2cd2a61c73311cf1b3 WatchSource:0}: Error finding container 02f7942a36038efd7589927d591c35bc47d745ee388eca2cd2a61c73311cf1b3: Status 404 returned error can't find the container with id 02f7942a36038efd7589927d591c35bc47d745ee388eca2cd2a61c73311cf1b3 Jul 17 22:13:07.400832 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:07.400795 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" event={"ID":"56b6ccbd-4772-46ed-94f2-7c834d77ff32","Type":"ContainerStarted","Data":"02f7942a36038efd7589927d591c35bc47d745ee388eca2cd2a61c73311cf1b3"} Jul 17 22:13:07.947120 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:07.947086 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:08.003759 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:08.003727 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:08.407075 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:08.407015 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" event={"ID":"56b6ccbd-4772-46ed-94f2-7c834d77ff32","Type":"ContainerStarted","Data":"2d274a07ab8d6d56ced5ddf8aacd98c9d3faba89fcc51b945114b0854e47acfa"} Jul 17 22:13:08.434384 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:08.434293 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s6mj" podStartSLOduration=0.860077758 podStartE2EDuration="2.434272358s" totalImagesPullingTime="1.5741946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:13:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:13:08.432203943 +0000 UTC m=+260.590392677" watchObservedRunningTime="2026-07-17 22:13:08.434272358 +0000 UTC m=+260.592461068" Jul 17 22:13:08.784207 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:08.784171 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:08.899465 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:08.899433 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:09.748652 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.748614 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw"] Jul 17 22:13:09.751016 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.750997 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.753965 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.753941 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 22:13:09.754111 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.753948 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 22:13:09.754111 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.754045 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bmfgp\"" Jul 17 22:13:09.760183 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.760158 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw"] Jul 17 22:13:09.869570 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.869508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.869570 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.869560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.869803 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.869680 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qksf7\" (UniqueName: \"kubernetes.io/projected/24ba7758-8198-4e9f-a359-d5731dbd8d60-kube-api-access-qksf7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.936062 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.936026 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:09.971078 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.971026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qksf7\" (UniqueName: \"kubernetes.io/projected/24ba7758-8198-4e9f-a359-d5731dbd8d60-kube-api-access-qksf7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.971078 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.971082 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.971278 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.971110 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.971462 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.971446 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.971520 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.971500 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:09.989055 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:09.989022 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qksf7\" (UniqueName: \"kubernetes.io/projected/24ba7758-8198-4e9f-a359-d5731dbd8d60-kube-api-access-qksf7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:10.052059 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:10.051975 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:10.060602 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:10.060575 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:10.198280 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:10.198256 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw"] Jul 17 22:13:10.200021 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:13:10.199989 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ba7758_8198_4e9f_a359_d5731dbd8d60.slice/crio-efec6ccc4b17e6ba8a8eb50d515fd7aaede2dc2f1b1a1743217f597d1c5488d5 WatchSource:0}: Error finding container efec6ccc4b17e6ba8a8eb50d515fd7aaede2dc2f1b1a1743217f597d1c5488d5: Status 404 returned error can't find the container with id efec6ccc4b17e6ba8a8eb50d515fd7aaede2dc2f1b1a1743217f597d1c5488d5 Jul 17 22:13:10.416316 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:10.416231 2556 generic.go:356] "Generic (PLEG): container finished" podID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerID="fc00768f44cc1f9e121f92956bcfe99762b788ab4e04ed34e99276c9891c0e37" exitCode=0 Jul 17 22:13:10.416316 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:10.416288 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" event={"ID":"24ba7758-8198-4e9f-a359-d5731dbd8d60","Type":"ContainerDied","Data":"fc00768f44cc1f9e121f92956bcfe99762b788ab4e04ed34e99276c9891c0e37"} Jul 17 22:13:10.416624 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:10.416349 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" event={"ID":"24ba7758-8198-4e9f-a359-d5731dbd8d60","Type":"ContainerStarted","Data":"efec6ccc4b17e6ba8a8eb50d515fd7aaede2dc2f1b1a1743217f597d1c5488d5"} Jul 17 22:13:12.141616 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:12.141576 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:12.367780 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:12.367743 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:13.432134 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:13.432094 2556 generic.go:356] "Generic (PLEG): container finished" podID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerID="e0325fdf03bd982992819865083b6afa52eb010664f265a18ddfe6486e93544e" exitCode=0 Jul 17 22:13:13.432134 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:13.432141 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" event={"ID":"24ba7758-8198-4e9f-a359-d5731dbd8d60","Type":"ContainerDied","Data":"e0325fdf03bd982992819865083b6afa52eb010664f265a18ddfe6486e93544e"} Jul 17 22:13:14.438347 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:14.438301 2556 generic.go:356] "Generic (PLEG): container finished" podID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerID="35be77cda7a87401e0dcfab0539407f0b302a1d4caee171b14fb258c901bbb59" exitCode=0 Jul 17 22:13:14.438721 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:14.438364 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" event={"ID":"24ba7758-8198-4e9f-a359-d5731dbd8d60","Type":"ContainerDied","Data":"35be77cda7a87401e0dcfab0539407f0b302a1d4caee171b14fb258c901bbb59"} Jul 17 22:13:14.719105 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:14.719012 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:14.783302 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:14.783271 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:15.576080 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.576050 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:15.719676 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.719585 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qksf7\" (UniqueName: \"kubernetes.io/projected/24ba7758-8198-4e9f-a359-d5731dbd8d60-kube-api-access-qksf7\") pod \"24ba7758-8198-4e9f-a359-d5731dbd8d60\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " Jul 17 22:13:15.719676 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.719636 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-util\") pod \"24ba7758-8198-4e9f-a359-d5731dbd8d60\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " Jul 17 22:13:15.719676 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.719669 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-bundle\") pod \"24ba7758-8198-4e9f-a359-d5731dbd8d60\" (UID: \"24ba7758-8198-4e9f-a359-d5731dbd8d60\") " Jul 17 22:13:15.720106 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.720079 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-bundle" (OuterVolumeSpecName: "bundle") pod "24ba7758-8198-4e9f-a359-d5731dbd8d60" (UID: "24ba7758-8198-4e9f-a359-d5731dbd8d60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:13:15.721717 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.721692 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ba7758-8198-4e9f-a359-d5731dbd8d60-kube-api-access-qksf7" (OuterVolumeSpecName: "kube-api-access-qksf7") pod "24ba7758-8198-4e9f-a359-d5731dbd8d60" (UID: "24ba7758-8198-4e9f-a359-d5731dbd8d60"). InnerVolumeSpecName "kube-api-access-qksf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:13:15.724275 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.724253 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-util" (OuterVolumeSpecName: "util") pod "24ba7758-8198-4e9f-a359-d5731dbd8d60" (UID: "24ba7758-8198-4e9f-a359-d5731dbd8d60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:13:15.820509 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.820466 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qksf7\" (UniqueName: \"kubernetes.io/projected/24ba7758-8198-4e9f-a359-d5731dbd8d60-kube-api-access-qksf7\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:13:15.820509 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.820500 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-util\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:13:15.820509 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:15.820510 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24ba7758-8198-4e9f-a359-d5731dbd8d60-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:13:16.448916 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:16.448888 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" Jul 17 22:13:16.448916 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:16.448901 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbn9cw" event={"ID":"24ba7758-8198-4e9f-a359-d5731dbd8d60","Type":"ContainerDied","Data":"efec6ccc4b17e6ba8a8eb50d515fd7aaede2dc2f1b1a1743217f597d1c5488d5"} Jul 17 22:13:16.449140 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:16.448943 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efec6ccc4b17e6ba8a8eb50d515fd7aaede2dc2f1b1a1743217f597d1c5488d5" Jul 17 22:13:17.101863 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:17.101831 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:17.169554 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:17.169516 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:19.370111 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:19.370078 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:19.486110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:19.486060 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:20.354254 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.354215 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:20.422119 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.422081 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jswxr"] Jul 17 22:13:20.422525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.422365 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerName="pull" Jul 17 22:13:20.422525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.422375 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerName="pull" Jul 17 22:13:20.422525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.422393 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerName="extract" Jul 17 22:13:20.422525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.422399 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerName="extract" Jul 17 22:13:20.422525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.422408 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerName="util" Jul 17 22:13:20.422525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.422413 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerName="util" Jul 17 22:13:20.422525 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.422463 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ba7758-8198-4e9f-a359-d5731dbd8d60" containerName="extract" Jul 17 22:13:20.424387 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.424370 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jswxr" Jul 17 22:13:20.428182 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.428160 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 17 22:13:20.428320 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.428160 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6tvvt\"" Jul 17 22:13:20.429208 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.429192 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 17 22:13:20.440467 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.440438 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jswxr"] Jul 17 22:13:20.560750 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.560713 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78e09f0d-ac1d-4d04-b5d7-7def1988fa9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-jswxr\" (UID: \"78e09f0d-ac1d-4d04-b5d7-7def1988fa9f\") " pod="cert-manager/cert-manager-55b4d954d5-jswxr" Jul 17 22:13:20.560923 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.560756 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk72b\" (UniqueName: \"kubernetes.io/projected/78e09f0d-ac1d-4d04-b5d7-7def1988fa9f-kube-api-access-pk72b\") pod \"cert-manager-55b4d954d5-jswxr\" (UID: \"78e09f0d-ac1d-4d04-b5d7-7def1988fa9f\") " pod="cert-manager/cert-manager-55b4d954d5-jswxr" Jul 17 22:13:20.661388 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.661281 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78e09f0d-ac1d-4d04-b5d7-7def1988fa9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-jswxr\" (UID: \"78e09f0d-ac1d-4d04-b5d7-7def1988fa9f\") " pod="cert-manager/cert-manager-55b4d954d5-jswxr" Jul 17 22:13:20.661388 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.661322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk72b\" (UniqueName: \"kubernetes.io/projected/78e09f0d-ac1d-4d04-b5d7-7def1988fa9f-kube-api-access-pk72b\") pod \"cert-manager-55b4d954d5-jswxr\" (UID: \"78e09f0d-ac1d-4d04-b5d7-7def1988fa9f\") " pod="cert-manager/cert-manager-55b4d954d5-jswxr" Jul 17 22:13:20.671835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.671804 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78e09f0d-ac1d-4d04-b5d7-7def1988fa9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-jswxr\" (UID: \"78e09f0d-ac1d-4d04-b5d7-7def1988fa9f\") " pod="cert-manager/cert-manager-55b4d954d5-jswxr" Jul 17 22:13:20.672099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.672076 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk72b\" (UniqueName: \"kubernetes.io/projected/78e09f0d-ac1d-4d04-b5d7-7def1988fa9f-kube-api-access-pk72b\") pod \"cert-manager-55b4d954d5-jswxr\" (UID: \"78e09f0d-ac1d-4d04-b5d7-7def1988fa9f\") " pod="cert-manager/cert-manager-55b4d954d5-jswxr" Jul 17 22:13:20.744569 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.744534 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jswxr" Jul 17 22:13:20.870885 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:20.870858 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jswxr"] Jul 17 22:13:20.873555 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:13:20.873526 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78e09f0d_ac1d_4d04_b5d7_7def1988fa9f.slice/crio-16d410d92cf9c3ff137fb2bfedbda0b521c5829ef21a35e57d3efe90e4ebfaf6 WatchSource:0}: Error finding container 16d410d92cf9c3ff137fb2bfedbda0b521c5829ef21a35e57d3efe90e4ebfaf6: Status 404 returned error can't find the container with id 16d410d92cf9c3ff137fb2bfedbda0b521c5829ef21a35e57d3efe90e4ebfaf6 Jul 17 22:13:21.472225 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:21.472190 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jswxr" event={"ID":"78e09f0d-ac1d-4d04-b5d7-7def1988fa9f","Type":"ContainerStarted","Data":"16d410d92cf9c3ff137fb2bfedbda0b521c5829ef21a35e57d3efe90e4ebfaf6"} Jul 17 22:13:23.483921 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:23.483824 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jswxr" event={"ID":"78e09f0d-ac1d-4d04-b5d7-7def1988fa9f","Type":"ContainerStarted","Data":"cb6c3427b808f7227b90d7e922438e67782a7797979d9efb5949e692b4c1b3c9"} Jul 17 22:13:23.509046 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:23.508990 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jswxr" podStartSLOduration=1.173763951 podStartE2EDuration="3.508972714s" totalImagesPullingTime="2.335208763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:13:23.506589568 +0000 UTC m=+275.664778271" watchObservedRunningTime="2026-07-17 22:13:23.508972714 +0000 UTC m=+275.667161418" Jul 17 22:13:25.685030 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:25.684993 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:25.792573 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:25.792534 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:27.714778 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:27.714744 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:27.850258 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:27.850217 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f"] Jul 17 22:13:27.874950 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:27.874916 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f"] Jul 17 22:13:27.875111 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:27.875019 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:27.878228 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:27.878202 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 22:13:27.878408 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:27.878321 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 22:13:27.878645 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:27.878626 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bmfgp\"" Jul 17 22:13:28.023367 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.023252 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.023367 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.023294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5q5t\" (UniqueName: \"kubernetes.io/projected/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-kube-api-access-p5q5t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.023559 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.023399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.124257 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.124215 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.124446 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.124373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.124446 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.124402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5q5t\" (UniqueName: \"kubernetes.io/projected/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-kube-api-access-p5q5t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.124722 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.124696 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.124793 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.124749 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.133110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.133084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5q5t\" (UniqueName: \"kubernetes.io/projected/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-kube-api-access-p5q5t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.184118 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.184083 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:28.315497 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.315469 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f"] Jul 17 22:13:28.317581 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:13:28.317553 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2d8bab_a591_4f4a_a07a_4efca8e94a4b.slice/crio-a64bbe22746cf841fc1170f12de39a25f6e04a9ccfe296c17f13a4aa89a83283 WatchSource:0}: Error finding container a64bbe22746cf841fc1170f12de39a25f6e04a9ccfe296c17f13a4aa89a83283: Status 404 returned error can't find the container with id a64bbe22746cf841fc1170f12de39a25f6e04a9ccfe296c17f13a4aa89a83283 Jul 17 22:13:28.507563 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.507531 2556 generic.go:356] "Generic (PLEG): container finished" podID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerID="2fc944c633a00ace1469988f05f954df3b0c62c09d6befe50b973cc103e79bb1" exitCode=0 Jul 17 22:13:28.507717 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.507623 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" event={"ID":"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b","Type":"ContainerDied","Data":"2fc944c633a00ace1469988f05f954df3b0c62c09d6befe50b973cc103e79bb1"} Jul 17 22:13:28.507717 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:28.507673 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" event={"ID":"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b","Type":"ContainerStarted","Data":"a64bbe22746cf841fc1170f12de39a25f6e04a9ccfe296c17f13a4aa89a83283"} Jul 17 22:13:29.513489 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:29.513451 2556 generic.go:356] "Generic (PLEG): container finished" podID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerID="fe071c93e834a05bd767b00142cd90092a10d8347d253de6dba3d73ce0ad7af5" exitCode=0 Jul 17 22:13:29.513978 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:29.513538 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" event={"ID":"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b","Type":"ContainerDied","Data":"fe071c93e834a05bd767b00142cd90092a10d8347d253de6dba3d73ce0ad7af5"} Jul 17 22:13:30.209457 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:30.209406 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:30.282678 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:30.282630 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:30.519975 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:30.519883 2556 generic.go:356] "Generic (PLEG): container finished" podID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerID="3579cd9d719d980b64b57d22bb9b08334326bd96fc187cf6295c881d12b4502c" exitCode=0 Jul 17 22:13:30.519975 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:30.519950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" event={"ID":"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b","Type":"ContainerDied","Data":"3579cd9d719d980b64b57d22bb9b08334326bd96fc187cf6295c881d12b4502c"} Jul 17 22:13:31.649061 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.649037 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:31.747446 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.747407 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5q5t\" (UniqueName: \"kubernetes.io/projected/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-kube-api-access-p5q5t\") pod \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " Jul 17 22:13:31.747615 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.747511 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-util\") pod \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " Jul 17 22:13:31.747615 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.747552 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-bundle\") pod \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\" (UID: \"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b\") " Jul 17 22:13:31.748217 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.748192 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-bundle" (OuterVolumeSpecName: "bundle") pod "3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" (UID: "3a2d8bab-a591-4f4a-a07a-4efca8e94a4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:13:31.749466 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.749442 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-kube-api-access-p5q5t" (OuterVolumeSpecName: "kube-api-access-p5q5t") pod "3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" (UID: "3a2d8bab-a591-4f4a-a07a-4efca8e94a4b"). InnerVolumeSpecName "kube-api-access-p5q5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:13:31.753021 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.752997 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-util" (OuterVolumeSpecName: "util") pod "3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" (UID: "3a2d8bab-a591-4f4a-a07a-4efca8e94a4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:13:31.848142 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.848044 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:13:31.848142 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.848088 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5q5t\" (UniqueName: \"kubernetes.io/projected/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-kube-api-access-p5q5t\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:13:31.848142 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:31.848099 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a2d8bab-a591-4f4a-a07a-4efca8e94a4b-util\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:13:32.530367 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:32.530313 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" event={"ID":"3a2d8bab-a591-4f4a-a07a-4efca8e94a4b","Type":"ContainerDied","Data":"a64bbe22746cf841fc1170f12de39a25f6e04a9ccfe296c17f13a4aa89a83283"} Jul 17 22:13:32.530367 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:32.530364 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7452f" Jul 17 22:13:32.530577 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:32.530378 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a64bbe22746cf841fc1170f12de39a25f6e04a9ccfe296c17f13a4aa89a83283" Jul 17 22:13:41.531769 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:41.531721 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:41.627327 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:41.627276 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:42.152085 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.152049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:42.441109 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.441071 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:42.539631 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.539598 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:42.564032 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.563998 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd"] Jul 17 22:13:42.564293 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.564281 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerName="extract" Jul 17 22:13:42.564368 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.564294 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerName="extract" Jul 17 22:13:42.564368 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.564311 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerName="pull" Jul 17 22:13:42.564368 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.564316 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerName="pull" Jul 17 22:13:42.564368 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.564324 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerName="util" Jul 17 22:13:42.564368 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.564346 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerName="util" Jul 17 22:13:42.564528 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.564391 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2d8bab-a591-4f4a-a07a-4efca8e94a4b" containerName="extract" Jul 17 22:13:42.567251 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.567233 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.571688 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.571658 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 22:13:42.572449 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.572425 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 22:13:42.573326 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.573306 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 22:13:42.573534 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.573519 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hh4w5\"" Jul 17 22:13:42.573620 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.573541 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 22:13:42.584531 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.584506 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd"] Jul 17 22:13:42.629571 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.629539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7lmf\" (UniqueName: \"kubernetes.io/projected/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-kube-api-access-k7lmf\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.629735 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.629589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-tmp\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.629735 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.629661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.629835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.629748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.629835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.629792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-manifests\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.730716 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.730617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-tmp\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.730716 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.730664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.730716 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.730700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.730994 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.730828 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-manifests\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.730994 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.730887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7lmf\" (UniqueName: \"kubernetes.io/projected/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-kube-api-access-k7lmf\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.731178 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.731156 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-manifests\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.732883 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.732858 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-tmp\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.733006 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.732988 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.733140 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.733123 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.743054 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.743025 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7lmf\" (UniqueName: \"kubernetes.io/projected/d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3-kube-api-access-k7lmf\") pod \"opendatahub-operator-controller-manager-595c584869-ms5dd\" (UID: \"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3\") " pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.803011 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.802977 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:42.884351 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.884291 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:42.903540 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:42.903509 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:43.017460 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:43.017352 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:43.060966 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:43.060942 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd"] Jul 17 22:13:43.063695 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:13:43.063669 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1572b5a_f6c6_42dd_b9eb_30aa6ff6a8f3.slice/crio-72b10db4f1fad2e44b2d46879482a70b9ac1f0965fdb00ec1cc0bf2bd514f97b WatchSource:0}: Error finding container 72b10db4f1fad2e44b2d46879482a70b9ac1f0965fdb00ec1cc0bf2bd514f97b: Status 404 returned error can't find the container with id 72b10db4f1fad2e44b2d46879482a70b9ac1f0965fdb00ec1cc0bf2bd514f97b Jul 17 22:13:43.148292 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:43.148251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:43.241634 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:43.241591 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:43.343100 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:43.343016 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:43.582576 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:43.582541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" event={"ID":"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3","Type":"ContainerStarted","Data":"72b10db4f1fad2e44b2d46879482a70b9ac1f0965fdb00ec1cc0bf2bd514f97b"} Jul 17 22:13:46.600638 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:46.600605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" event={"ID":"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3","Type":"ContainerStarted","Data":"69a01bfb2e3032304f18e6acb0e4b2b6b8dfbf4839df0201063fb5c5d0648a17"} Jul 17 22:13:47.606976 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:47.606880 2556 generic.go:356] "Generic (PLEG): container finished" podID="d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3" containerID="69a01bfb2e3032304f18e6acb0e4b2b6b8dfbf4839df0201063fb5c5d0648a17" exitCode=0 Jul 17 22:13:47.607453 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:47.606968 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" event={"ID":"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3","Type":"ContainerDied","Data":"69a01bfb2e3032304f18e6acb0e4b2b6b8dfbf4839df0201063fb5c5d0648a17"} Jul 17 22:13:48.247047 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:48.246967 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/1.log" Jul 17 22:13:48.247275 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:48.247081 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/1.log" Jul 17 22:13:48.259840 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:48.259817 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 22:13:48.613183 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:48.613091 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" event={"ID":"d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3","Type":"ContainerStarted","Data":"57bf8d1b331bd35bab75cf3b6d372083ff8f03ad815851279666f5cf86403140"} Jul 17 22:13:48.615655 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:48.613254 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:13:48.645173 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:48.645116 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" podStartSLOduration=2.20672147 podStartE2EDuration="6.645095803s" totalImagesPullingTime="3.38763133s" totalInitContainerRuntime="1.050743003s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:13:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:13:48.639840234 +0000 UTC m=+300.798028939" watchObservedRunningTime="2026-07-17 22:13:48.645095803 +0000 UTC m=+300.803284508" Jul 17 22:13:50.694068 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:50.694036 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:52.183584 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:52.183550 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:54.114694 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:54.114656 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:54.225910 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:54.225858 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:54.334835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:54.334773 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:58.425635 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:58.425589 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:58.530471 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:58.530437 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:58.860766 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:58.860734 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:58.927900 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:58.927854 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:13:59.618984 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:13:59.618955 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-595c584869-ms5dd" Jul 17 22:14:00.243772 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.243739 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b44947954-nsffk"] Jul 17 22:14:00.250500 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.250474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.253243 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.253216 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 22:14:00.254630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.254567 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 22:14:00.254630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.254590 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pfzk5\"" Jul 17 22:14:00.255273 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.254871 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 22:14:00.255273 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.255005 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 22:14:00.255273 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.255066 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 22:14:00.256708 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.256685 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b44947954-nsffk"] Jul 17 22:14:00.379641 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.379607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-manager-config\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.379641 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.379641 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sppn6\" (UniqueName: \"kubernetes.io/projected/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-kube-api-access-sppn6\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.379843 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.379746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-cert\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.379843 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.379799 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-metrics-cert\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.481067 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.481030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-cert\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.481067 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.481069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-metrics-cert\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.481261 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.481100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-manager-config\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.481261 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.481116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sppn6\" (UniqueName: \"kubernetes.io/projected/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-kube-api-access-sppn6\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.481878 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.481853 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-manager-config\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.483542 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.483520 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-metrics-cert\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.483678 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.483655 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-cert\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.491044 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.491021 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sppn6\" (UniqueName: \"kubernetes.io/projected/c7c25b6a-50b0-4cbd-919a-6a0a38f36122-kube-api-access-sppn6\") pod \"lws-controller-manager-5b44947954-nsffk\" (UID: \"c7c25b6a-50b0-4cbd-919a-6a0a38f36122\") " pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.560238 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.560147 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:00.692973 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.692948 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b44947954-nsffk"] Jul 17 22:14:00.700274 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:14:00.695361 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c25b6a_50b0_4cbd_919a_6a0a38f36122.slice/crio-ccf4f960de9d30f6a73332629c9460ac825eeb858d03820e30cba4ed25f25a8f WatchSource:0}: Error finding container ccf4f960de9d30f6a73332629c9460ac825eeb858d03820e30cba4ed25f25a8f: Status 404 returned error can't find the container with id ccf4f960de9d30f6a73332629c9460ac825eeb858d03820e30cba4ed25f25a8f Jul 17 22:14:00.701932 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:00.701915 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 22:14:01.672858 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:01.672822 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" event={"ID":"c7c25b6a-50b0-4cbd-919a-6a0a38f36122","Type":"ContainerStarted","Data":"ccf4f960de9d30f6a73332629c9460ac825eeb858d03820e30cba4ed25f25a8f"} Jul 17 22:14:01.815807 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:01.815760 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:02.097473 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:02.097433 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:02.334308 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:02.334227 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:02.612544 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:02.612463 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:02.679062 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:02.679023 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" event={"ID":"c7c25b6a-50b0-4cbd-919a-6a0a38f36122","Type":"ContainerStarted","Data":"4dd22732d337507ffa6dbf6e4d915a7790ceeabb1f443283d212b8526aa449e5"} Jul 17 22:14:02.679273 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:02.679163 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:02.719002 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:02.718951 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" podStartSLOduration=1.376940791 podStartE2EDuration="2.718934116s" totalImagesPullingTime="1.341993325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:14:02.718516473 +0000 UTC m=+314.876705177" watchObservedRunningTime="2026-07-17 22:14:02.718934116 +0000 UTC m=+314.877122820" Jul 17 22:14:02.736290 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:02.736248 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:03.131790 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:03.131750 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:03.659698 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:03.659663 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:03.840240 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:03.840210 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:04.157490 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:04.157450 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:04.297110 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:04.297072 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:05.646708 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:05.646652 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:09.866853 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.866817 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h"] Jul 17 22:14:09.871618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.871601 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:09.876153 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.876126 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 17 22:14:09.876413 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.876396 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 22:14:09.876781 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.876767 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-74wsv\"" Jul 17 22:14:09.877282 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.877259 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 17 22:14:09.881318 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.881302 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 17 22:14:09.890540 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.890511 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h"] Jul 17 22:14:09.915745 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.915716 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:09.963522 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.963490 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:09.963671 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.963532 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bea1e31-4ac4-4115-918a-6ab67e6085e9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:09.963671 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.963569 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:09.963671 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.963595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:09.963671 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.963615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:09.963671 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.963644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:09.963849 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:09.963680 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scj68\" (UniqueName: \"kubernetes.io/projected/8bea1e31-4ac4-4115-918a-6ab67e6085e9-kube-api-access-scj68\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.046805 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.046773 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:10.064445 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.064419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bea1e31-4ac4-4115-918a-6ab67e6085e9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.064609 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.064461 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.064609 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.064481 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.064728 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.064603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.064728 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.064671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.064835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.064728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scj68\" (UniqueName: \"kubernetes.io/projected/8bea1e31-4ac4-4115-918a-6ab67e6085e9-kube-api-access-scj68\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.064835 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.064779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.065162 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.065137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.067033 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.067007 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.067133 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.067096 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.067133 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.067099 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bea1e31-4ac4-4115-918a-6ab67e6085e9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.067233 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.067217 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8bea1e31-4ac4-4115-918a-6ab67e6085e9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.078294 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.078270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bea1e31-4ac4-4115-918a-6ab67e6085e9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.078693 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.078674 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scj68\" (UniqueName: \"kubernetes.io/projected/8bea1e31-4ac4-4115-918a-6ab67e6085e9-kube-api-access-scj68\") pod \"istiod-openshift-gateway-94bb8fbfd-6pj8h\" (UID: \"8bea1e31-4ac4-4115-918a-6ab67e6085e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.182138 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.182061 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:10.327868 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.327808 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h"] Jul 17 22:14:10.330163 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:14:10.330132 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bea1e31_4ac4_4115_918a_6ab67e6085e9.slice/crio-3922e58e500f535b1383ef9a506056f65abbcd04747dca360bfe769a75133e56 WatchSource:0}: Error finding container 3922e58e500f535b1383ef9a506056f65abbcd04747dca360bfe769a75133e56: Status 404 returned error can't find the container with id 3922e58e500f535b1383ef9a506056f65abbcd04747dca360bfe769a75133e56 Jul 17 22:14:10.722502 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.722455 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" event={"ID":"8bea1e31-4ac4-4115-918a-6ab67e6085e9","Type":"ContainerStarted","Data":"3922e58e500f535b1383ef9a506056f65abbcd04747dca360bfe769a75133e56"} Jul 17 22:14:10.808803 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:10.808720 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:11.034966 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:11.034871 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:11.175434 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:11.175392 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:12.548234 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:12.548191 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 22:14:12.548619 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:12.548274 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 22:14:12.734946 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:12.734915 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" event={"ID":"8bea1e31-4ac4-4115-918a-6ab67e6085e9","Type":"ContainerStarted","Data":"8534c4b79877c72df49aa227f88eacd776302826e2479b3ab657166bef0da3ce"} Jul 17 22:14:12.735129 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:12.735024 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:12.772317 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:12.772267 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" podStartSLOduration=1.5567575470000001 podStartE2EDuration="3.772249258s" totalImagesPullingTime="2.215491711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:14:12.771765443 +0000 UTC m=+324.929954147" watchObservedRunningTime="2026-07-17 22:14:12.772249258 +0000 UTC m=+324.930437962" Jul 17 22:14:12.940941 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:12.940898 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:13.129016 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:13.128977 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:13.221430 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:13.221325 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:13.492245 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:13.492166 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:13.687394 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:13.687365 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b44947954-nsffk" Jul 17 22:14:13.741482 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:13.741453 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6pj8h" Jul 17 22:14:14.392978 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:14.392933 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:14.489159 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:14.489125 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:14.570605 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:14.570573 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:16.247955 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:16.247903 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:16.340426 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:16.340386 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:17.671392 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:17.671358 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:14:17.768945 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:14:17.768912 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:03.257318 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:03.257225 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:03.589136 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:03.589055 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:03.689966 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:03.689929 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:04.275059 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:04.275024 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:04.374128 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:04.374089 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:04.476019 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:04.475986 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:18.579191 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.579148 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx"] Jul 17 22:15:18.581704 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.581684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.584179 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.584154 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 22:15:18.584290 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.584189 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 22:15:18.585374 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.585355 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nkcf4\"" Jul 17 22:15:18.591257 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.591238 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx"] Jul 17 22:15:18.651757 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.651724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl2nb\" (UniqueName: \"kubernetes.io/projected/54b2e4ec-5d56-401f-b637-8ac6bab887a8-kube-api-access-wl2nb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.651930 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.651780 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.651930 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.651844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.752745 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.752704 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl2nb\" (UniqueName: \"kubernetes.io/projected/54b2e4ec-5d56-401f-b637-8ac6bab887a8-kube-api-access-wl2nb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.752917 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.752753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.752917 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.752803 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.753152 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.753136 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.753189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.753164 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.760959 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.760935 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl2nb\" (UniqueName: \"kubernetes.io/projected/54b2e4ec-5d56-401f-b637-8ac6bab887a8-kube-api-access-wl2nb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:18.891779 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:18.891691 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:19.018720 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.018696 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx"] Jul 17 22:15:19.020413 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:15:19.020386 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b2e4ec_5d56_401f_b637_8ac6bab887a8.slice/crio-e1d9c3025292955bf9e1a5160b5a431b1cf6ca6f83162ad53ec43ea287a98b4c WatchSource:0}: Error finding container e1d9c3025292955bf9e1a5160b5a431b1cf6ca6f83162ad53ec43ea287a98b4c: Status 404 returned error can't find the container with id e1d9c3025292955bf9e1a5160b5a431b1cf6ca6f83162ad53ec43ea287a98b4c Jul 17 22:15:19.382476 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.382441 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q"] Jul 17 22:15:19.385112 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.385090 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.393356 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.393310 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q"] Jul 17 22:15:19.458530 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.458496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.458689 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.458537 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qlv6\" (UniqueName: \"kubernetes.io/projected/3caf17c3-a2cf-4283-8082-1d6728c51818-kube-api-access-6qlv6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.458689 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.458562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.559343 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.559305 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.559490 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.559383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qlv6\" (UniqueName: \"kubernetes.io/projected/3caf17c3-a2cf-4283-8082-1d6728c51818-kube-api-access-6qlv6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.559490 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.559413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.559675 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.559655 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.559777 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.559757 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.568607 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.568574 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qlv6\" (UniqueName: \"kubernetes.io/projected/3caf17c3-a2cf-4283-8082-1d6728c51818-kube-api-access-6qlv6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.695679 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.695649 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:19.823179 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.823154 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q"] Jul 17 22:15:19.825432 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:15:19.825404 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3caf17c3_a2cf_4283_8082_1d6728c51818.slice/crio-1eb09e51f757d714dff769846bd3340e36a6cc4b873d6140739d37d0542a3224 WatchSource:0}: Error finding container 1eb09e51f757d714dff769846bd3340e36a6cc4b873d6140739d37d0542a3224: Status 404 returned error can't find the container with id 1eb09e51f757d714dff769846bd3340e36a6cc4b873d6140739d37d0542a3224 Jul 17 22:15:19.977521 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.977437 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5"] Jul 17 22:15:19.980529 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.980499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:19.988514 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:19.988488 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5"] Jul 17 22:15:20.030416 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.030384 2556 generic.go:356] "Generic (PLEG): container finished" podID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerID="ef3d71b2967e84283bcf49219f949e3306b47042793085172a80184a87a4064c" exitCode=0 Jul 17 22:15:20.030587 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.030476 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" event={"ID":"3caf17c3-a2cf-4283-8082-1d6728c51818","Type":"ContainerDied","Data":"ef3d71b2967e84283bcf49219f949e3306b47042793085172a80184a87a4064c"} Jul 17 22:15:20.030587 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.030535 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" event={"ID":"3caf17c3-a2cf-4283-8082-1d6728c51818","Type":"ContainerStarted","Data":"1eb09e51f757d714dff769846bd3340e36a6cc4b873d6140739d37d0542a3224"} Jul 17 22:15:20.032127 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.032110 2556 generic.go:356] "Generic (PLEG): container finished" podID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerID="5b71d0fc4ceb0f2019898bbd8dac00fde7aef859f404489a2fc8840f84193191" exitCode=0 Jul 17 22:15:20.032210 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.032139 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" event={"ID":"54b2e4ec-5d56-401f-b637-8ac6bab887a8","Type":"ContainerDied","Data":"5b71d0fc4ceb0f2019898bbd8dac00fde7aef859f404489a2fc8840f84193191"} Jul 17 22:15:20.032210 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.032183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" event={"ID":"54b2e4ec-5d56-401f-b637-8ac6bab887a8","Type":"ContainerStarted","Data":"e1d9c3025292955bf9e1a5160b5a431b1cf6ca6f83162ad53ec43ea287a98b4c"} Jul 17 22:15:20.062025 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.061993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.062154 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.062104 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.062195 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.062161 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbjb2\" (UniqueName: \"kubernetes.io/projected/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-kube-api-access-qbjb2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.162987 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.162949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.163148 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.162999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjb2\" (UniqueName: \"kubernetes.io/projected/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-kube-api-access-qbjb2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.163148 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.163032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.163313 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.163292 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.163445 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.163427 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.171606 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.171579 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjb2\" (UniqueName: \"kubernetes.io/projected/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-kube-api-access-qbjb2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.303208 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.303123 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:20.389218 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.389182 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp"] Jul 17 22:15:20.392676 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.392650 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.399562 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.399537 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp"] Jul 17 22:15:20.439641 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.439615 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5"] Jul 17 22:15:20.441659 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:15:20.441623 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0aac44a_2944_4b9e_ad1e_2c4beebd9865.slice/crio-f2f8627661378a99e04d6d39ea26b759c9dd329ea04ae61ffc39730293f37301 WatchSource:0}: Error finding container f2f8627661378a99e04d6d39ea26b759c9dd329ea04ae61ffc39730293f37301: Status 404 returned error can't find the container with id f2f8627661378a99e04d6d39ea26b759c9dd329ea04ae61ffc39730293f37301 Jul 17 22:15:20.465052 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.465031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.465139 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.465066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mssqx\" (UniqueName: \"kubernetes.io/projected/d6ba17d4-c384-4600-b365-c5e5dcddeb00-kube-api-access-mssqx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.465189 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.465167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.566080 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.566016 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.566227 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.566081 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.566227 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.566105 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mssqx\" (UniqueName: \"kubernetes.io/projected/d6ba17d4-c384-4600-b365-c5e5dcddeb00-kube-api-access-mssqx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.566445 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.566422 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.566530 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.566466 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.575159 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.575137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mssqx\" (UniqueName: \"kubernetes.io/projected/d6ba17d4-c384-4600-b365-c5e5dcddeb00-kube-api-access-mssqx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.704830 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.704789 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:20.840164 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:20.840108 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp"] Jul 17 22:15:20.863905 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:15:20.863873 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ba17d4_c384_4600_b365_c5e5dcddeb00.slice/crio-9cc87094ec6f324ae9e708822c272347469576ef5f9837ff1b11333e3751d44f WatchSource:0}: Error finding container 9cc87094ec6f324ae9e708822c272347469576ef5f9837ff1b11333e3751d44f: Status 404 returned error can't find the container with id 9cc87094ec6f324ae9e708822c272347469576ef5f9837ff1b11333e3751d44f Jul 17 22:15:21.039380 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:21.039321 2556 generic.go:356] "Generic (PLEG): container finished" podID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerID="e0fe00998725a56a70bdd12016cf1a9ec1ac5602663252d26e7a1776b8330069" exitCode=0 Jul 17 22:15:21.039540 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:21.039372 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" event={"ID":"3caf17c3-a2cf-4283-8082-1d6728c51818","Type":"ContainerDied","Data":"e0fe00998725a56a70bdd12016cf1a9ec1ac5602663252d26e7a1776b8330069"} Jul 17 22:15:21.041146 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:21.041118 2556 generic.go:356] "Generic (PLEG): container finished" podID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerID="7bf8fa33a7920e68305629dbbc05f3479858d10d1e26b23a5e37c89d6182dcfa" exitCode=0 Jul 17 22:15:21.041263 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:21.041146 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" event={"ID":"d6ba17d4-c384-4600-b365-c5e5dcddeb00","Type":"ContainerDied","Data":"7bf8fa33a7920e68305629dbbc05f3479858d10d1e26b23a5e37c89d6182dcfa"} Jul 17 22:15:21.041263 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:21.041193 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" event={"ID":"d6ba17d4-c384-4600-b365-c5e5dcddeb00","Type":"ContainerStarted","Data":"9cc87094ec6f324ae9e708822c272347469576ef5f9837ff1b11333e3751d44f"} Jul 17 22:15:21.042909 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:21.042886 2556 generic.go:356] "Generic (PLEG): container finished" podID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerID="c951246fbf1b373a61f25f538d6a1362f7ed6dbcb71133f8ff49c0c9399371b3" exitCode=0 Jul 17 22:15:21.043019 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:21.042945 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" event={"ID":"c0aac44a-2944-4b9e-ad1e-2c4beebd9865","Type":"ContainerDied","Data":"c951246fbf1b373a61f25f538d6a1362f7ed6dbcb71133f8ff49c0c9399371b3"} Jul 17 22:15:21.043019 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:21.042987 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" event={"ID":"c0aac44a-2944-4b9e-ad1e-2c4beebd9865","Type":"ContainerStarted","Data":"f2f8627661378a99e04d6d39ea26b759c9dd329ea04ae61ffc39730293f37301"} Jul 17 22:15:22.049327 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:22.049297 2556 generic.go:356] "Generic (PLEG): container finished" podID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerID="699469529a029654f8a72f4dce7137b7d9bfb31337831d5fa1f8bcb9112d2775" exitCode=0 Jul 17 22:15:22.049736 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:22.049369 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" event={"ID":"3caf17c3-a2cf-4283-8082-1d6728c51818","Type":"ContainerDied","Data":"699469529a029654f8a72f4dce7137b7d9bfb31337831d5fa1f8bcb9112d2775"} Jul 17 22:15:22.051063 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:22.051040 2556 generic.go:356] "Generic (PLEG): container finished" podID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerID="ee70139e2db8e817da5d6b152f68e21dd9eb5580c9b5230db1e1ffdb36f77cbb" exitCode=0 Jul 17 22:15:22.051195 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:22.051065 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" event={"ID":"d6ba17d4-c384-4600-b365-c5e5dcddeb00","Type":"ContainerDied","Data":"ee70139e2db8e817da5d6b152f68e21dd9eb5580c9b5230db1e1ffdb36f77cbb"} Jul 17 22:15:22.052975 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:22.052958 2556 generic.go:356] "Generic (PLEG): container finished" podID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerID="2016e9d1549ecc5791b7b350cc073578758310e43c4bbae5a888b3a686812778" exitCode=0 Jul 17 22:15:22.053082 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:22.053049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" event={"ID":"c0aac44a-2944-4b9e-ad1e-2c4beebd9865","Type":"ContainerDied","Data":"2016e9d1549ecc5791b7b350cc073578758310e43c4bbae5a888b3a686812778"} Jul 17 22:15:22.055002 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:22.054982 2556 generic.go:356] "Generic (PLEG): container finished" podID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerID="f10e08644bb3b7b5548bc7c5ffe598cc7582bb3368f65933213fea4770681e4a" exitCode=0 Jul 17 22:15:22.055081 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:22.055025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" event={"ID":"54b2e4ec-5d56-401f-b637-8ac6bab887a8","Type":"ContainerDied","Data":"f10e08644bb3b7b5548bc7c5ffe598cc7582bb3368f65933213fea4770681e4a"} Jul 17 22:15:23.061931 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.061896 2556 generic.go:356] "Generic (PLEG): container finished" podID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerID="4aff0463055cd2f3ad5d52602b82f17e7007c19dc9dd5b272664b6a2a7ceb5e3" exitCode=0 Jul 17 22:15:23.062325 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.061981 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" event={"ID":"54b2e4ec-5d56-401f-b637-8ac6bab887a8","Type":"ContainerDied","Data":"4aff0463055cd2f3ad5d52602b82f17e7007c19dc9dd5b272664b6a2a7ceb5e3"} Jul 17 22:15:23.063871 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.063847 2556 generic.go:356] "Generic (PLEG): container finished" podID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerID="ad83b202e5f23c897de1e5e7170c608f5c8257b1da10712ed357c124fb8ae8dc" exitCode=0 Jul 17 22:15:23.063981 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.063924 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" event={"ID":"d6ba17d4-c384-4600-b365-c5e5dcddeb00","Type":"ContainerDied","Data":"ad83b202e5f23c897de1e5e7170c608f5c8257b1da10712ed357c124fb8ae8dc"} Jul 17 22:15:23.065783 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.065758 2556 generic.go:356] "Generic (PLEG): container finished" podID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerID="e2f3b2eb8318c48aedb95ca243db628b8ab723e3264b3922ba05c1f9c234ddda" exitCode=0 Jul 17 22:15:23.065891 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.065810 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" event={"ID":"c0aac44a-2944-4b9e-ad1e-2c4beebd9865","Type":"ContainerDied","Data":"e2f3b2eb8318c48aedb95ca243db628b8ab723e3264b3922ba05c1f9c234ddda"} Jul 17 22:15:23.193160 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.193135 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:23.286161 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.286132 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-util\") pod \"3caf17c3-a2cf-4283-8082-1d6728c51818\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " Jul 17 22:15:23.286161 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.286164 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-bundle\") pod \"3caf17c3-a2cf-4283-8082-1d6728c51818\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " Jul 17 22:15:23.286366 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.286235 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qlv6\" (UniqueName: \"kubernetes.io/projected/3caf17c3-a2cf-4283-8082-1d6728c51818-kube-api-access-6qlv6\") pod \"3caf17c3-a2cf-4283-8082-1d6728c51818\" (UID: \"3caf17c3-a2cf-4283-8082-1d6728c51818\") " Jul 17 22:15:23.286655 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.286626 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-bundle" (OuterVolumeSpecName: "bundle") pod "3caf17c3-a2cf-4283-8082-1d6728c51818" (UID: "3caf17c3-a2cf-4283-8082-1d6728c51818"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:15:23.288392 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.288369 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3caf17c3-a2cf-4283-8082-1d6728c51818-kube-api-access-6qlv6" (OuterVolumeSpecName: "kube-api-access-6qlv6") pod "3caf17c3-a2cf-4283-8082-1d6728c51818" (UID: "3caf17c3-a2cf-4283-8082-1d6728c51818"). InnerVolumeSpecName "kube-api-access-6qlv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:15:23.291480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.291455 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-util" (OuterVolumeSpecName: "util") pod "3caf17c3-a2cf-4283-8082-1d6728c51818" (UID: "3caf17c3-a2cf-4283-8082-1d6728c51818"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:15:23.386889 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.386796 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qlv6\" (UniqueName: \"kubernetes.io/projected/3caf17c3-a2cf-4283-8082-1d6728c51818-kube-api-access-6qlv6\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:23.386889 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.386828 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-util\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:23.386889 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:23.386840 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3caf17c3-a2cf-4283-8082-1d6728c51818-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.073653 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.073612 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" Jul 17 22:15:24.074032 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.073657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q" event={"ID":"3caf17c3-a2cf-4283-8082-1d6728c51818","Type":"ContainerDied","Data":"1eb09e51f757d714dff769846bd3340e36a6cc4b873d6140739d37d0542a3224"} Jul 17 22:15:24.074032 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.073702 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1eb09e51f757d714dff769846bd3340e36a6cc4b873d6140739d37d0542a3224" Jul 17 22:15:24.225682 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.225653 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:24.264954 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.264919 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:24.268506 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.268486 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:24.295080 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295056 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-bundle\") pod \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " Jul 17 22:15:24.295223 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295087 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-util\") pod \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " Jul 17 22:15:24.295223 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295117 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mssqx\" (UniqueName: \"kubernetes.io/projected/d6ba17d4-c384-4600-b365-c5e5dcddeb00-kube-api-access-mssqx\") pod \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " Jul 17 22:15:24.295223 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295164 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-util\") pod \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " Jul 17 22:15:24.295223 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295197 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-bundle\") pod \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\" (UID: \"d6ba17d4-c384-4600-b365-c5e5dcddeb00\") " Jul 17 22:15:24.295464 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295229 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbjb2\" (UniqueName: \"kubernetes.io/projected/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-kube-api-access-qbjb2\") pod \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " Jul 17 22:15:24.295464 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295254 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-bundle\") pod \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\" (UID: \"c0aac44a-2944-4b9e-ad1e-2c4beebd9865\") " Jul 17 22:15:24.295464 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295290 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-util\") pod \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " Jul 17 22:15:24.295464 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295365 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl2nb\" (UniqueName: \"kubernetes.io/projected/54b2e4ec-5d56-401f-b637-8ac6bab887a8-kube-api-access-wl2nb\") pod \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\" (UID: \"54b2e4ec-5d56-401f-b637-8ac6bab887a8\") " Jul 17 22:15:24.296324 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295824 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-bundle" (OuterVolumeSpecName: "bundle") pod "d6ba17d4-c384-4600-b365-c5e5dcddeb00" (UID: "d6ba17d4-c384-4600-b365-c5e5dcddeb00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:15:24.296324 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.295820 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-bundle" (OuterVolumeSpecName: "bundle") pod "54b2e4ec-5d56-401f-b637-8ac6bab887a8" (UID: "54b2e4ec-5d56-401f-b637-8ac6bab887a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:15:24.296655 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.296634 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-bundle" (OuterVolumeSpecName: "bundle") pod "c0aac44a-2944-4b9e-ad1e-2c4beebd9865" (UID: "c0aac44a-2944-4b9e-ad1e-2c4beebd9865"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:15:24.298970 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.298945 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b2e4ec-5d56-401f-b637-8ac6bab887a8-kube-api-access-wl2nb" (OuterVolumeSpecName: "kube-api-access-wl2nb") pod "54b2e4ec-5d56-401f-b637-8ac6bab887a8" (UID: "54b2e4ec-5d56-401f-b637-8ac6bab887a8"). InnerVolumeSpecName "kube-api-access-wl2nb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:15:24.299066 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.298950 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6ba17d4-c384-4600-b365-c5e5dcddeb00-kube-api-access-mssqx" (OuterVolumeSpecName: "kube-api-access-mssqx") pod "d6ba17d4-c384-4600-b365-c5e5dcddeb00" (UID: "d6ba17d4-c384-4600-b365-c5e5dcddeb00"). InnerVolumeSpecName "kube-api-access-mssqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:15:24.299317 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.299284 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-kube-api-access-qbjb2" (OuterVolumeSpecName: "kube-api-access-qbjb2") pod "c0aac44a-2944-4b9e-ad1e-2c4beebd9865" (UID: "c0aac44a-2944-4b9e-ad1e-2c4beebd9865"). InnerVolumeSpecName "kube-api-access-qbjb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:15:24.305246 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.305214 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-util" (OuterVolumeSpecName: "util") pod "c0aac44a-2944-4b9e-ad1e-2c4beebd9865" (UID: "c0aac44a-2944-4b9e-ad1e-2c4beebd9865"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:15:24.305794 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.305768 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-util" (OuterVolumeSpecName: "util") pod "d6ba17d4-c384-4600-b365-c5e5dcddeb00" (UID: "d6ba17d4-c384-4600-b365-c5e5dcddeb00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:15:24.306819 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.306797 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-util" (OuterVolumeSpecName: "util") pod "54b2e4ec-5d56-401f-b637-8ac6bab887a8" (UID: "54b2e4ec-5d56-401f-b637-8ac6bab887a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 22:15:24.396618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396548 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mssqx\" (UniqueName: \"kubernetes.io/projected/d6ba17d4-c384-4600-b365-c5e5dcddeb00-kube-api-access-mssqx\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.396618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396574 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-util\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.396618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396583 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.396618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396592 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbjb2\" (UniqueName: \"kubernetes.io/projected/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-kube-api-access-qbjb2\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.396618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396602 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0aac44a-2944-4b9e-ad1e-2c4beebd9865-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.396618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396610 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-util\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.396618 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396617 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl2nb\" (UniqueName: \"kubernetes.io/projected/54b2e4ec-5d56-401f-b637-8ac6bab887a8-kube-api-access-wl2nb\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.396906 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396625 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b2e4ec-5d56-401f-b637-8ac6bab887a8-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:24.396906 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:24.396634 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6ba17d4-c384-4600-b365-c5e5dcddeb00-util\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:15:25.080453 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.080423 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" Jul 17 22:15:25.080938 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.080454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5" event={"ID":"c0aac44a-2944-4b9e-ad1e-2c4beebd9865","Type":"ContainerDied","Data":"f2f8627661378a99e04d6d39ea26b759c9dd329ea04ae61ffc39730293f37301"} Jul 17 22:15:25.080938 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.080506 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2f8627661378a99e04d6d39ea26b759c9dd329ea04ae61ffc39730293f37301" Jul 17 22:15:25.082289 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.082269 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" Jul 17 22:15:25.082420 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.082288 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx" event={"ID":"54b2e4ec-5d56-401f-b637-8ac6bab887a8","Type":"ContainerDied","Data":"e1d9c3025292955bf9e1a5160b5a431b1cf6ca6f83162ad53ec43ea287a98b4c"} Jul 17 22:15:25.082420 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.082344 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1d9c3025292955bf9e1a5160b5a431b1cf6ca6f83162ad53ec43ea287a98b4c" Jul 17 22:15:25.084266 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.084243 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" event={"ID":"d6ba17d4-c384-4600-b365-c5e5dcddeb00","Type":"ContainerDied","Data":"9cc87094ec6f324ae9e708822c272347469576ef5f9837ff1b11333e3751d44f"} Jul 17 22:15:25.084391 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.084278 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp" Jul 17 22:15:25.084391 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:25.084283 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cc87094ec6f324ae9e708822c272347469576ef5f9837ff1b11333e3751d44f" Jul 17 22:15:27.048883 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:27.048830 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:31.037527 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:31.037489 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:34.818170 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:34.818141 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:40.036015 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:40.035974 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:40.837394 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:40.837360 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:44.803079 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:44.803042 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:44.904750 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:44.904721 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:48.609017 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:48.608982 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:48.831551 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:48.831514 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:48.933493 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:48.933414 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:57.885274 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:57.885239 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:15:59.926853 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:15:59.926811 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:01.306513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:01.306478 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:02.479508 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:02.479471 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:04.037626 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:04.037566 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:04.097382 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:04.097328 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:04.441023 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:04.440993 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:04.501379 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:04.501315 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:09.038582 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:09.038547 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:09.138951 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:09.138912 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:12.446614 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:12.446508 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:12.546903 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:12.546865 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:15.588381 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:15.588327 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:15.688451 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:15.688420 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:24.420490 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:24.420450 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:24.521552 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:24.521511 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:27.018051 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:27.018008 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:27.119373 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:27.119317 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:30.216372 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:30.216313 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:30.330037 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:30.329993 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:33.618546 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:33.618511 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:33.720081 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:33.720044 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:39.203493 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:39.203455 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:39.544199 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:39.544096 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:42.201089 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:42.201058 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:42.301366 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:42.301319 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:42.684473 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:42.684445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:49.825913 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.825874 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7f69bb4c-bd45w"] Jul 17 22:16:49.826710 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826686 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerName="pull" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826712 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerName="pull" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826724 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerName="pull" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826732 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerName="pull" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826744 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerName="util" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826752 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerName="util" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826761 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerName="extract" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826769 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerName="extract" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826780 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerName="util" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826788 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerName="util" Jul 17 22:16:49.826797 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826798 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerName="pull" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826807 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerName="pull" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826817 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerName="util" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826825 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerName="util" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826851 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerName="pull" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826861 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerName="pull" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826871 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826879 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826896 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerName="util" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826903 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerName="util" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826913 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826921 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826933 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.826941 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.827024 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6ba17d4-c384-4600-b365-c5e5dcddeb00" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.827036 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="54b2e4ec-5d56-401f-b637-8ac6bab887a8" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.827045 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0aac44a-2944-4b9e-ad1e-2c4beebd9865" containerName="extract" Jul 17 22:16:49.827300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.827056 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3caf17c3-a2cf-4283-8082-1d6728c51818" containerName="extract" Jul 17 22:16:49.830320 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.830298 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:49.841161 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.841134 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7f69bb4c-bd45w"] Jul 17 22:16:49.879848 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.879812 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:49.914183 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.914138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-service-ca\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:49.914183 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.914184 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-trusted-ca-bundle\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:49.914412 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.914205 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-serving-cert\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:49.914412 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.914252 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7fzw\" (UniqueName: \"kubernetes.io/projected/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-kube-api-access-n7fzw\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:49.914412 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.914269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-oauth-config\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:49.914412 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.914303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-config\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:49.914412 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.914323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-oauth-serving-cert\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:49.982870 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:49.982834 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:50.015599 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.015561 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-trusted-ca-bundle\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.015768 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.015606 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-serving-cert\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.015768 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.015648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7fzw\" (UniqueName: \"kubernetes.io/projected/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-kube-api-access-n7fzw\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.015768 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.015673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-oauth-config\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.015768 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.015737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-config\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.015936 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.015902 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-oauth-serving-cert\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.016030 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.016009 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-service-ca\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.016527 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.016500 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-config\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.016674 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.016571 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-trusted-ca-bundle\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.016674 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.016649 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-service-ca\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.016798 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.016693 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-oauth-serving-cert\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.018300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.018270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-serving-cert\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.018300 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.018285 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-console-oauth-config\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.025176 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.025156 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7fzw\" (UniqueName: \"kubernetes.io/projected/98e9d2df-70f1-4934-8bd9-6dc61a623cdf-kube-api-access-n7fzw\") pod \"console-5f7f69bb4c-bd45w\" (UID: \"98e9d2df-70f1-4934-8bd9-6dc61a623cdf\") " pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.081842 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.081768 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:50.141434 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.141399 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:16:50.280783 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.280756 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7f69bb4c-bd45w"] Jul 17 22:16:50.282244 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:16:50.282218 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e9d2df_70f1_4934_8bd9_6dc61a623cdf.slice/crio-c229a8dc98b3963ddb51c54cf713dac7e72a19a1765c24c53e9b0842910303b2 WatchSource:0}: Error finding container c229a8dc98b3963ddb51c54cf713dac7e72a19a1765c24c53e9b0842910303b2: Status 404 returned error can't find the container with id c229a8dc98b3963ddb51c54cf713dac7e72a19a1765c24c53e9b0842910303b2 Jul 17 22:16:50.479905 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.479868 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7f69bb4c-bd45w" event={"ID":"98e9d2df-70f1-4934-8bd9-6dc61a623cdf","Type":"ContainerStarted","Data":"4f20aa7877999b541c3749f25c77ef77236aaf839beee9fe577c5ff757d133f9"} Jul 17 22:16:50.480072 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.479917 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7f69bb4c-bd45w" event={"ID":"98e9d2df-70f1-4934-8bd9-6dc61a623cdf","Type":"ContainerStarted","Data":"c229a8dc98b3963ddb51c54cf713dac7e72a19a1765c24c53e9b0842910303b2"} Jul 17 22:16:50.500583 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.500528 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f7f69bb4c-bd45w" podStartSLOduration=1.5005132460000001 podStartE2EDuration="1.500513246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:16:50.498578744 +0000 UTC m=+482.656767476" watchObservedRunningTime="2026-07-17 22:16:50.500513246 +0000 UTC m=+482.658701950" Jul 17 22:16:50.620664 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.620573 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:50.721944 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:50.721908 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:54.607287 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.607251 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g54s2"] Jul 17 22:16:54.610621 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.610597 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:54.611122 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.611099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:54.613400 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.613311 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 22:16:54.613400 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.613367 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nkcf4\"" Jul 17 22:16:54.613657 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.613471 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 17 22:16:54.614656 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.614634 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 22:16:54.617353 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.617321 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g54s2"] Jul 17 22:16:54.702829 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.702786 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g54s2"] Jul 17 22:16:54.715681 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.715650 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:54.759268 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.759236 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wpj8\" (UniqueName: \"kubernetes.io/projected/4befad8e-58c4-49df-92d7-56921c117936-kube-api-access-9wpj8\") pod \"limitador-limitador-64c94fd64f-g54s2\" (UID: \"4befad8e-58c4-49df-92d7-56921c117936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:54.759457 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.759273 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4befad8e-58c4-49df-92d7-56921c117936-config-file\") pod \"limitador-limitador-64c94fd64f-g54s2\" (UID: \"4befad8e-58c4-49df-92d7-56921c117936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:54.771798 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.771769 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:54.860132 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.860050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wpj8\" (UniqueName: \"kubernetes.io/projected/4befad8e-58c4-49df-92d7-56921c117936-kube-api-access-9wpj8\") pod \"limitador-limitador-64c94fd64f-g54s2\" (UID: \"4befad8e-58c4-49df-92d7-56921c117936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:54.860132 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.860088 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4befad8e-58c4-49df-92d7-56921c117936-config-file\") pod \"limitador-limitador-64c94fd64f-g54s2\" (UID: \"4befad8e-58c4-49df-92d7-56921c117936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:54.860715 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.860697 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4befad8e-58c4-49df-92d7-56921c117936-config-file\") pod \"limitador-limitador-64c94fd64f-g54s2\" (UID: \"4befad8e-58c4-49df-92d7-56921c117936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:54.868550 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.868527 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wpj8\" (UniqueName: \"kubernetes.io/projected/4befad8e-58c4-49df-92d7-56921c117936-kube-api-access-9wpj8\") pod \"limitador-limitador-64c94fd64f-g54s2\" (UID: \"4befad8e-58c4-49df-92d7-56921c117936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:54.922249 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:54.922202 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:55.068680 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:55.068655 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g54s2"] Jul 17 22:16:55.070538 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:16:55.070511 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4befad8e_58c4_49df_92d7_56921c117936.slice/crio-e5d2166f597c030cb0f9d8e3cd9c12d62cd6bc1baf9daa628e68fe34d9d752d8 WatchSource:0}: Error finding container e5d2166f597c030cb0f9d8e3cd9c12d62cd6bc1baf9daa628e68fe34d9d752d8: Status 404 returned error can't find the container with id e5d2166f597c030cb0f9d8e3cd9c12d62cd6bc1baf9daa628e68fe34d9d752d8 Jul 17 22:16:55.501053 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:55.501014 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:55.504615 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:55.504587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" event={"ID":"4befad8e-58c4-49df-92d7-56921c117936","Type":"ContainerStarted","Data":"e5d2166f597c030cb0f9d8e3cd9c12d62cd6bc1baf9daa628e68fe34d9d752d8"} Jul 17 22:16:55.559788 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:55.559755 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:16:58.523736 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:58.523703 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" event={"ID":"4befad8e-58c4-49df-92d7-56921c117936","Type":"ContainerStarted","Data":"3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b"} Jul 17 22:16:58.524106 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:58.523760 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:16:58.541016 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:16:58.540968 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" podStartSLOduration=1.63070085 podStartE2EDuration="4.540952524s" totalImagesPullingTime="2.910251674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:16:58.540008471 +0000 UTC m=+490.698197176" watchObservedRunningTime="2026-07-17 22:16:58.540952524 +0000 UTC m=+490.699141263" Jul 17 22:17:00.141560 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:00.141520 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:17:00.141989 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:00.141604 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:17:00.147134 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:00.147102 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:17:00.537434 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:00.537397 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f7f69bb4c-bd45w" Jul 17 22:17:00.587257 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:00.587220 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64fcb5496b-d45w8"] Jul 17 22:17:00.699805 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:00.699761 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:00.800627 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:00.800512 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:00.902214 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:00.902171 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:09.530668 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:09.530632 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:17:10.012635 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.012592 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g54s2"] Jul 17 22:17:10.012877 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.012848 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" podUID="4befad8e-58c4-49df-92d7-56921c117936" containerName="limitador" containerID="cri-o://3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b" gracePeriod=30 Jul 17 22:17:10.567438 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.567412 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:17:10.581544 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.581463 2556 generic.go:356] "Generic (PLEG): container finished" podID="4befad8e-58c4-49df-92d7-56921c117936" containerID="3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b" exitCode=0 Jul 17 22:17:10.581544 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.581509 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" Jul 17 22:17:10.581752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.581553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" event={"ID":"4befad8e-58c4-49df-92d7-56921c117936","Type":"ContainerDied","Data":"3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b"} Jul 17 22:17:10.581752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.581623 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g54s2" event={"ID":"4befad8e-58c4-49df-92d7-56921c117936","Type":"ContainerDied","Data":"e5d2166f597c030cb0f9d8e3cd9c12d62cd6bc1baf9daa628e68fe34d9d752d8"} Jul 17 22:17:10.581752 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.581667 2556 scope.go:117] "RemoveContainer" containerID="3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b" Jul 17 22:17:10.591014 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.590991 2556 scope.go:117] "RemoveContainer" containerID="3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b" Jul 17 22:17:10.591306 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:17:10.591275 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b\": container with ID starting with 3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b not found: ID does not exist" containerID="3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b" Jul 17 22:17:10.591603 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.591324 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b"} err="failed to get container status \"3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b\": rpc error: code = NotFound desc = could not find container \"3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b\": container with ID starting with 3277220b48b80408feefe612abc68c2537e9318000faccdceee20cc07ffa706b not found: ID does not exist" Jul 17 22:17:10.598813 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.598785 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4befad8e-58c4-49df-92d7-56921c117936-config-file\") pod \"4befad8e-58c4-49df-92d7-56921c117936\" (UID: \"4befad8e-58c4-49df-92d7-56921c117936\") " Jul 17 22:17:10.598950 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.598857 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wpj8\" (UniqueName: \"kubernetes.io/projected/4befad8e-58c4-49df-92d7-56921c117936-kube-api-access-9wpj8\") pod \"4befad8e-58c4-49df-92d7-56921c117936\" (UID: \"4befad8e-58c4-49df-92d7-56921c117936\") " Jul 17 22:17:10.599207 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.599180 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4befad8e-58c4-49df-92d7-56921c117936-config-file" (OuterVolumeSpecName: "config-file") pod "4befad8e-58c4-49df-92d7-56921c117936" (UID: "4befad8e-58c4-49df-92d7-56921c117936"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:17:10.599947 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.599926 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4befad8e-58c4-49df-92d7-56921c117936-config-file\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:10.601099 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.601075 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4befad8e-58c4-49df-92d7-56921c117936-kube-api-access-9wpj8" (OuterVolumeSpecName: "kube-api-access-9wpj8") pod "4befad8e-58c4-49df-92d7-56921c117936" (UID: "4befad8e-58c4-49df-92d7-56921c117936"). InnerVolumeSpecName "kube-api-access-9wpj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:17:10.701002 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.700967 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wpj8\" (UniqueName: \"kubernetes.io/projected/4befad8e-58c4-49df-92d7-56921c117936-kube-api-access-9wpj8\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:10.907041 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.907002 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g54s2"] Jul 17 22:17:10.910020 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:10.909992 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g54s2"] Jul 17 22:17:11.229508 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:11.229476 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4befad8e-58c4-49df-92d7-56921c117936" path="/var/lib/kubelet/pods/4befad8e-58c4-49df-92d7-56921c117936/volumes" Jul 17 22:17:12.435506 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.435478 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:12.532407 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.532373 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:12.866786 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.866708 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4"] Jul 17 22:17:12.867195 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.867180 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4befad8e-58c4-49df-92d7-56921c117936" containerName="limitador" Jul 17 22:17:12.867236 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.867198 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4befad8e-58c4-49df-92d7-56921c117936" containerName="limitador" Jul 17 22:17:12.867280 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.867270 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4befad8e-58c4-49df-92d7-56921c117936" containerName="limitador" Jul 17 22:17:12.870571 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.870550 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:12.873425 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.873404 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 22:17:12.873684 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.873448 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 17 22:17:12.873790 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.873493 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 17 22:17:12.874640 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.874618 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v8l7b\"" Jul 17 22:17:12.880176 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.880148 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4"] Jul 17 22:17:12.908776 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.908752 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:12.919480 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.919454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7819c5c7-bf71-4add-af37-3eaee6f52abf-data\") pod \"postgres-69fb4594cf-n9qw4\" (UID: \"7819c5c7-bf71-4add-af37-3eaee6f52abf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:12.919612 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:12.919516 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6dsf\" (UniqueName: \"kubernetes.io/projected/7819c5c7-bf71-4add-af37-3eaee6f52abf-kube-api-access-t6dsf\") pod \"postgres-69fb4594cf-n9qw4\" (UID: \"7819c5c7-bf71-4add-af37-3eaee6f52abf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:13.020561 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:13.020517 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6dsf\" (UniqueName: \"kubernetes.io/projected/7819c5c7-bf71-4add-af37-3eaee6f52abf-kube-api-access-t6dsf\") pod \"postgres-69fb4594cf-n9qw4\" (UID: \"7819c5c7-bf71-4add-af37-3eaee6f52abf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:13.020760 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:13.020595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7819c5c7-bf71-4add-af37-3eaee6f52abf-data\") pod \"postgres-69fb4594cf-n9qw4\" (UID: \"7819c5c7-bf71-4add-af37-3eaee6f52abf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:13.020993 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:13.020970 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7819c5c7-bf71-4add-af37-3eaee6f52abf-data\") pod \"postgres-69fb4594cf-n9qw4\" (UID: \"7819c5c7-bf71-4add-af37-3eaee6f52abf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:13.029403 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:13.029373 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6dsf\" (UniqueName: \"kubernetes.io/projected/7819c5c7-bf71-4add-af37-3eaee6f52abf-kube-api-access-t6dsf\") pod \"postgres-69fb4594cf-n9qw4\" (UID: \"7819c5c7-bf71-4add-af37-3eaee6f52abf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:13.181844 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:13.181756 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:13.315373 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:13.315344 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4"] Jul 17 22:17:13.317607 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:17:13.317570 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7819c5c7_bf71_4add_af37_3eaee6f52abf.slice/crio-fe26f478346322ea5b8be5c98768cb6bae76e185a3237fc67fe5ed7be994f958 WatchSource:0}: Error finding container fe26f478346322ea5b8be5c98768cb6bae76e185a3237fc67fe5ed7be994f958: Status 404 returned error can't find the container with id fe26f478346322ea5b8be5c98768cb6bae76e185a3237fc67fe5ed7be994f958 Jul 17 22:17:13.598132 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:13.598095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" event={"ID":"7819c5c7-bf71-4add-af37-3eaee6f52abf","Type":"ContainerStarted","Data":"fe26f478346322ea5b8be5c98768cb6bae76e185a3237fc67fe5ed7be994f958"} Jul 17 22:17:18.629648 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:18.629592 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" event={"ID":"7819c5c7-bf71-4add-af37-3eaee6f52abf","Type":"ContainerStarted","Data":"3bc39c498a3a00b2aa3d361bb17ffd46280cbbe9136b9c64c70d373f65929105"} Jul 17 22:17:18.630129 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:18.629714 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:18.646109 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:18.646058 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" podStartSLOduration=1.483417022 podStartE2EDuration="6.646045649s" totalImagesPullingTime="5.162628627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:17:18.645290767 +0000 UTC m=+510.803479499" watchObservedRunningTime="2026-07-17 22:17:18.646045649 +0000 UTC m=+510.804234353" Jul 17 22:17:24.668098 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:24.668067 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n9qw4" Jul 17 22:17:25.012080 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.012034 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:25.300549 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.300444 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:25.610326 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.610234 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64fcb5496b-d45w8" podUID="2b3bb769-80a3-4c79-b248-212572687494" containerName="console" containerID="cri-o://276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8" gracePeriod=15 Jul 17 22:17:25.864511 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.864454 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:17:25.932865 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.932835 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-oauth-serving-cert\") pod \"2b3bb769-80a3-4c79-b248-212572687494\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " Jul 17 22:17:25.933031 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.932894 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-oauth-config\") pod \"2b3bb769-80a3-4c79-b248-212572687494\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " Jul 17 22:17:25.933031 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.932919 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-serving-cert\") pod \"2b3bb769-80a3-4c79-b248-212572687494\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " Jul 17 22:17:25.933131 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933037 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckj2z\" (UniqueName: \"kubernetes.io/projected/2b3bb769-80a3-4c79-b248-212572687494-kube-api-access-ckj2z\") pod \"2b3bb769-80a3-4c79-b248-212572687494\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " Jul 17 22:17:25.933131 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933079 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-service-ca\") pod \"2b3bb769-80a3-4c79-b248-212572687494\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " Jul 17 22:17:25.933131 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933126 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-console-config\") pod \"2b3bb769-80a3-4c79-b248-212572687494\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " Jul 17 22:17:25.933294 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933170 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-trusted-ca-bundle\") pod \"2b3bb769-80a3-4c79-b248-212572687494\" (UID: \"2b3bb769-80a3-4c79-b248-212572687494\") " Jul 17 22:17:25.933294 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933259 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b3bb769-80a3-4c79-b248-212572687494" (UID: "2b3bb769-80a3-4c79-b248-212572687494"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:17:25.933580 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933553 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-console-config" (OuterVolumeSpecName: "console-config") pod "2b3bb769-80a3-4c79-b248-212572687494" (UID: "2b3bb769-80a3-4c79-b248-212572687494"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:17:25.933669 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933557 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b3bb769-80a3-4c79-b248-212572687494" (UID: "2b3bb769-80a3-4c79-b248-212572687494"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:17:25.933669 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933594 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-oauth-serving-cert\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:25.933669 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.933596 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2b3bb769-80a3-4c79-b248-212572687494" (UID: "2b3bb769-80a3-4c79-b248-212572687494"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 22:17:25.935165 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.935143 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3bb769-80a3-4c79-b248-212572687494-kube-api-access-ckj2z" (OuterVolumeSpecName: "kube-api-access-ckj2z") pod "2b3bb769-80a3-4c79-b248-212572687494" (UID: "2b3bb769-80a3-4c79-b248-212572687494"). InnerVolumeSpecName "kube-api-access-ckj2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:17:25.935512 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.935489 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b3bb769-80a3-4c79-b248-212572687494" (UID: "2b3bb769-80a3-4c79-b248-212572687494"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:17:25.935609 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:25.935509 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b3bb769-80a3-4c79-b248-212572687494" (UID: "2b3bb769-80a3-4c79-b248-212572687494"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:17:26.034863 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.034826 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-oauth-config\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:26.034863 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.034858 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b3bb769-80a3-4c79-b248-212572687494-console-serving-cert\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:26.034863 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.034870 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckj2z\" (UniqueName: \"kubernetes.io/projected/2b3bb769-80a3-4c79-b248-212572687494-kube-api-access-ckj2z\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:26.035087 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.034881 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-service-ca\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:26.035087 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.034894 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-console-config\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:26.035087 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.034905 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3bb769-80a3-4c79-b248-212572687494-trusted-ca-bundle\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:26.675969 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.675933 2556 generic.go:356] "Generic (PLEG): container finished" podID="2b3bb769-80a3-4c79-b248-212572687494" containerID="276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8" exitCode=0 Jul 17 22:17:26.676176 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.675988 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fcb5496b-d45w8" Jul 17 22:17:26.676176 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.676022 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fcb5496b-d45w8" event={"ID":"2b3bb769-80a3-4c79-b248-212572687494","Type":"ContainerDied","Data":"276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8"} Jul 17 22:17:26.676176 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.676080 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fcb5496b-d45w8" event={"ID":"2b3bb769-80a3-4c79-b248-212572687494","Type":"ContainerDied","Data":"183793fc341ef56de413150835c53dd89bc0d8cc436c73e671f74a0113f7b0ba"} Jul 17 22:17:26.676176 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.676108 2556 scope.go:117] "RemoveContainer" containerID="276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8" Jul 17 22:17:26.685642 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.685624 2556 scope.go:117] "RemoveContainer" containerID="276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8" Jul 17 22:17:26.685875 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:17:26.685856 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8\": container with ID starting with 276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8 not found: ID does not exist" containerID="276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8" Jul 17 22:17:26.685926 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.685884 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8"} err="failed to get container status \"276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8\": rpc error: code = NotFound desc = could not find container \"276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8\": container with ID starting with 276cbf2f928e028b638b13d488733e485e660ebb1beff873010ba595d5a751e8 not found: ID does not exist" Jul 17 22:17:26.698566 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.698544 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64fcb5496b-d45w8"] Jul 17 22:17:26.702137 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:26.702115 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64fcb5496b-d45w8"] Jul 17 22:17:27.230305 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:27.230272 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3bb769-80a3-4c79-b248-212572687494" path="/var/lib/kubelet/pods/2b3bb769-80a3-4c79-b248-212572687494/volumes" Jul 17 22:17:31.577856 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.577824 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:31.591361 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.591318 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84946c4f5d-xblhn"] Jul 17 22:17:31.591792 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.591768 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3bb769-80a3-4c79-b248-212572687494" containerName="console" Jul 17 22:17:31.591931 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.591848 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3bb769-80a3-4c79-b248-212572687494" containerName="console" Jul 17 22:17:31.591999 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.591955 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3bb769-80a3-4c79-b248-212572687494" containerName="console" Jul 17 22:17:31.613555 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.613520 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84946c4f5d-xblhn"] Jul 17 22:17:31.613720 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.613669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:31.616845 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.616821 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 22:17:31.617090 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.617068 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f6wk2\"" Jul 17 22:17:31.617447 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.617425 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 22:17:31.678916 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.678881 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert\") pod \"maas-controller-84946c4f5d-xblhn\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:31.679120 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.678926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgxfq\" (UniqueName: \"kubernetes.io/projected/e467673c-034f-4cec-96be-04a39b47dcd8-kube-api-access-lgxfq\") pod \"maas-controller-84946c4f5d-xblhn\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:31.679790 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.679753 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:31.752861 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.752827 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:31.757486 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.757456 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d7c667b-zsd75"] Jul 17 22:17:31.759679 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.759660 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:31.769548 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.769521 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d7c667b-zsd75"] Jul 17 22:17:31.779652 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.779626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgxfq\" (UniqueName: \"kubernetes.io/projected/e467673c-034f-4cec-96be-04a39b47dcd8-kube-api-access-lgxfq\") pod \"maas-controller-84946c4f5d-xblhn\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:31.779792 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.779728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert\") pod \"maas-controller-84946c4f5d-xblhn\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:31.779865 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:17:31.779850 2556 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 17 22:17:31.779943 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:17:31.779930 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert podName:e467673c-034f-4cec-96be-04a39b47dcd8 nodeName:}" failed. No retries permitted until 2026-07-17 22:17:32.279909366 +0000 UTC m=+524.438098065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert") pod "maas-controller-84946c4f5d-xblhn" (UID: "e467673c-034f-4cec-96be-04a39b47dcd8") : secret "maas-controller-webhook-cert" not found Jul 17 22:17:31.788796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.788770 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgxfq\" (UniqueName: \"kubernetes.io/projected/e467673c-034f-4cec-96be-04a39b47dcd8-kube-api-access-lgxfq\") pod \"maas-controller-84946c4f5d-xblhn\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:31.869367 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.869259 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:31.880603 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.880580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bc93797-79ae-4e02-9ace-5bcc20a1242b-webhook-cert\") pod \"maas-controller-d7c667b-zsd75\" (UID: \"2bc93797-79ae-4e02-9ace-5bcc20a1242b\") " pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:31.880668 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.880640 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n99jj\" (UniqueName: \"kubernetes.io/projected/2bc93797-79ae-4e02-9ace-5bcc20a1242b-kube-api-access-n99jj\") pod \"maas-controller-d7c667b-zsd75\" (UID: \"2bc93797-79ae-4e02-9ace-5bcc20a1242b\") " pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:31.981988 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.981952 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bc93797-79ae-4e02-9ace-5bcc20a1242b-webhook-cert\") pod \"maas-controller-d7c667b-zsd75\" (UID: \"2bc93797-79ae-4e02-9ace-5bcc20a1242b\") " pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:31.982157 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.982015 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n99jj\" (UniqueName: \"kubernetes.io/projected/2bc93797-79ae-4e02-9ace-5bcc20a1242b-kube-api-access-n99jj\") pod \"maas-controller-d7c667b-zsd75\" (UID: \"2bc93797-79ae-4e02-9ace-5bcc20a1242b\") " pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:31.984350 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.984306 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bc93797-79ae-4e02-9ace-5bcc20a1242b-webhook-cert\") pod \"maas-controller-d7c667b-zsd75\" (UID: \"2bc93797-79ae-4e02-9ace-5bcc20a1242b\") " pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:31.990924 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:31.990898 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n99jj\" (UniqueName: \"kubernetes.io/projected/2bc93797-79ae-4e02-9ace-5bcc20a1242b-kube-api-access-n99jj\") pod \"maas-controller-d7c667b-zsd75\" (UID: \"2bc93797-79ae-4e02-9ace-5bcc20a1242b\") " pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:32.070485 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:32.070449 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:32.199552 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:32.199525 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d7c667b-zsd75"] Jul 17 22:17:32.201387 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:17:32.201359 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc93797_79ae_4e02_9ace_5bcc20a1242b.slice/crio-2c763b32b1edbd8a264f55edd70b33f07c0b4000012baf12e398352c5980153a WatchSource:0}: Error finding container 2c763b32b1edbd8a264f55edd70b33f07c0b4000012baf12e398352c5980153a: Status 404 returned error can't find the container with id 2c763b32b1edbd8a264f55edd70b33f07c0b4000012baf12e398352c5980153a Jul 17 22:17:32.285007 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:32.284977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert\") pod \"maas-controller-84946c4f5d-xblhn\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:32.287378 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:32.287346 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert\") pod \"maas-controller-84946c4f5d-xblhn\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:32.524957 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:32.524923 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:32.654423 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:32.654397 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84946c4f5d-xblhn"] Jul 17 22:17:32.656579 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:17:32.656546 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode467673c_034f_4cec_96be_04a39b47dcd8.slice/crio-bcd7c54111309f1fb1633ecf688187e7abd204fcb11bed7e2046736f3203d295 WatchSource:0}: Error finding container bcd7c54111309f1fb1633ecf688187e7abd204fcb11bed7e2046736f3203d295: Status 404 returned error can't find the container with id bcd7c54111309f1fb1633ecf688187e7abd204fcb11bed7e2046736f3203d295 Jul 17 22:17:32.707296 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:32.707254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d7c667b-zsd75" event={"ID":"2bc93797-79ae-4e02-9ace-5bcc20a1242b","Type":"ContainerStarted","Data":"2c763b32b1edbd8a264f55edd70b33f07c0b4000012baf12e398352c5980153a"} Jul 17 22:17:32.708726 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:32.708699 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84946c4f5d-xblhn" event={"ID":"e467673c-034f-4cec-96be-04a39b47dcd8","Type":"ContainerStarted","Data":"bcd7c54111309f1fb1633ecf688187e7abd204fcb11bed7e2046736f3203d295"} Jul 17 22:17:34.721222 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:34.721186 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84946c4f5d-xblhn" event={"ID":"e467673c-034f-4cec-96be-04a39b47dcd8","Type":"ContainerStarted","Data":"d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f"} Jul 17 22:17:34.721704 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:34.721322 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:34.722653 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:34.722633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d7c667b-zsd75" event={"ID":"2bc93797-79ae-4e02-9ace-5bcc20a1242b","Type":"ContainerStarted","Data":"332ae5b29de5422cea0f960a8fd8b33f0a3cee55ad1db32ceabbe93be8bc2df2"} Jul 17 22:17:34.722751 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:34.722743 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:34.760790 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:34.760740 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84946c4f5d-xblhn" podStartSLOduration=1.8105263809999999 podStartE2EDuration="3.760722569s" totalImagesPullingTime="1.950196188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:17:34.758991594 +0000 UTC m=+526.917180300" watchObservedRunningTime="2026-07-17 22:17:34.760722569 +0000 UTC m=+526.918911296" Jul 17 22:17:34.786304 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:34.786248 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d7c667b-zsd75" podStartSLOduration=1.387450328 podStartE2EDuration="3.786231189s" totalImagesPullingTime="2.398780861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:17:34.784432381 +0000 UTC m=+526.942621110" watchObservedRunningTime="2026-07-17 22:17:34.786231189 +0000 UTC m=+526.944419893" Jul 17 22:17:34.815934 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:34.815901 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:34.949380 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:34.949316 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:40.549882 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:40.549846 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:40.650732 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:40.650703 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:43.703441 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:43.703406 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:43.763303 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:43.763254 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:17:45.730197 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:45.730151 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d7c667b-zsd75" Jul 17 22:17:45.730659 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:45.730237 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:45.790809 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:45.790776 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84946c4f5d-xblhn"] Jul 17 22:17:45.790984 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:45.790954 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84946c4f5d-xblhn" podUID="e467673c-034f-4cec-96be-04a39b47dcd8" containerName="manager" containerID="cri-o://d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f" gracePeriod=30 Jul 17 22:17:46.034900 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.034876 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:46.207495 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.207462 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert\") pod \"e467673c-034f-4cec-96be-04a39b47dcd8\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " Jul 17 22:17:46.207671 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.207514 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgxfq\" (UniqueName: \"kubernetes.io/projected/e467673c-034f-4cec-96be-04a39b47dcd8-kube-api-access-lgxfq\") pod \"e467673c-034f-4cec-96be-04a39b47dcd8\" (UID: \"e467673c-034f-4cec-96be-04a39b47dcd8\") " Jul 17 22:17:46.209708 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.209673 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e467673c-034f-4cec-96be-04a39b47dcd8" (UID: "e467673c-034f-4cec-96be-04a39b47dcd8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 22:17:46.209816 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.209759 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e467673c-034f-4cec-96be-04a39b47dcd8-kube-api-access-lgxfq" (OuterVolumeSpecName: "kube-api-access-lgxfq") pod "e467673c-034f-4cec-96be-04a39b47dcd8" (UID: "e467673c-034f-4cec-96be-04a39b47dcd8"). InnerVolumeSpecName "kube-api-access-lgxfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 22:17:46.308286 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.308192 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e467673c-034f-4cec-96be-04a39b47dcd8-webhook-cert\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:46.308286 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.308227 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgxfq\" (UniqueName: \"kubernetes.io/projected/e467673c-034f-4cec-96be-04a39b47dcd8-kube-api-access-lgxfq\") on node \"ip-10-0-142-78.ec2.internal\" DevicePath \"\"" Jul 17 22:17:46.782664 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.782625 2556 generic.go:356] "Generic (PLEG): container finished" podID="e467673c-034f-4cec-96be-04a39b47dcd8" containerID="d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f" exitCode=0 Jul 17 22:17:46.783109 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.782676 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84946c4f5d-xblhn" Jul 17 22:17:46.783109 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.782708 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84946c4f5d-xblhn" event={"ID":"e467673c-034f-4cec-96be-04a39b47dcd8","Type":"ContainerDied","Data":"d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f"} Jul 17 22:17:46.783109 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.782762 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84946c4f5d-xblhn" event={"ID":"e467673c-034f-4cec-96be-04a39b47dcd8","Type":"ContainerDied","Data":"bcd7c54111309f1fb1633ecf688187e7abd204fcb11bed7e2046736f3203d295"} Jul 17 22:17:46.783109 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.782783 2556 scope.go:117] "RemoveContainer" containerID="d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f" Jul 17 22:17:46.791864 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.791691 2556 scope.go:117] "RemoveContainer" containerID="d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f" Jul 17 22:17:46.791975 ip-10-0-142-78 kubenswrapper[2556]: E0717 22:17:46.791956 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f\": container with ID starting with d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f not found: ID does not exist" containerID="d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f" Jul 17 22:17:46.792017 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.791986 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f"} err="failed to get container status \"d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f\": rpc error: code = NotFound desc = could not find container \"d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f\": container with ID starting with d25d3c51b186ef7f363f6997c36c98febb2bcf08ed811e1198abc6edc5a5bb6f not found: ID does not exist" Jul 17 22:17:46.804353 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.804305 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84946c4f5d-xblhn"] Jul 17 22:17:46.807485 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:46.807462 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84946c4f5d-xblhn"] Jul 17 22:17:47.230130 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:47.230100 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e467673c-034f-4cec-96be-04a39b47dcd8" path="/var/lib/kubelet/pods/e467673c-034f-4cec-96be-04a39b47dcd8/volumes" Jul 17 22:17:58.088473 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:17:58.088437 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:05.945697 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:05.945665 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:06.043960 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.043923 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:06.488954 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.488926 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:06.586142 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.586107 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5"] Jul 17 22:18:06.586444 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.586431 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e467673c-034f-4cec-96be-04a39b47dcd8" containerName="manager" Jul 17 22:18:06.586493 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.586446 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e467673c-034f-4cec-96be-04a39b47dcd8" containerName="manager" Jul 17 22:18:06.586529 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.586510 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e467673c-034f-4cec-96be-04a39b47dcd8" containerName="manager" Jul 17 22:18:06.594512 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.594491 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.597074 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.597043 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 17 22:18:06.597074 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.597047 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bdk49\"" Jul 17 22:18:06.602194 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.602033 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5"] Jul 17 22:18:06.672106 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.672067 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5c6p\" (UniqueName: \"kubernetes.io/projected/a29b3855-915c-4df6-a46d-bf60f11a0071-kube-api-access-j5c6p\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.672106 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.672107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a29b3855-915c-4df6-a46d-bf60f11a0071-maas-api-tls\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.672314 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.672175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29b3855-915c-4df6-a46d-bf60f11a0071-openshift-service-ca\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.772734 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.772631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a29b3855-915c-4df6-a46d-bf60f11a0071-maas-api-tls\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.772734 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.772702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29b3855-915c-4df6-a46d-bf60f11a0071-openshift-service-ca\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.772979 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.772812 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5c6p\" (UniqueName: \"kubernetes.io/projected/a29b3855-915c-4df6-a46d-bf60f11a0071-kube-api-access-j5c6p\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.773624 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.773577 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a29b3855-915c-4df6-a46d-bf60f11a0071-openshift-service-ca\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.773791 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.773635 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:06.775738 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.775721 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a29b3855-915c-4df6-a46d-bf60f11a0071-maas-api-tls\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.784713 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.784690 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5c6p\" (UniqueName: \"kubernetes.io/projected/a29b3855-915c-4df6-a46d-bf60f11a0071-kube-api-access-j5c6p\") pod \"maas-api-5dbd8cdb89-6q4k5\" (UID: \"a29b3855-915c-4df6-a46d-bf60f11a0071\") " pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.905860 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.905820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:06.941536 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:06.941502 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:07.026912 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.026831 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:07.032851 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.032825 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6z9kd"] Jul 17 22:18:07.036529 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.036510 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:07.039385 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.039359 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 17 22:18:07.047266 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.047207 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6z9kd"] Jul 17 22:18:07.050709 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.050683 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5"] Jul 17 22:18:07.052186 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:18:07.052162 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29b3855_915c_4df6_a46d_bf60f11a0071.slice/crio-b68592267697ec2017f9093be0635fe43e0c33db0a1fdef45c2165125402e694 WatchSource:0}: Error finding container b68592267697ec2017f9093be0635fe43e0c33db0a1fdef45c2165125402e694: Status 404 returned error can't find the container with id b68592267697ec2017f9093be0635fe43e0c33db0a1fdef45c2165125402e694 Jul 17 22:18:07.074999 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.074960 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd4d107-daca-49a5-a3d3-15de6737394a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6z9kd\" (UID: \"dfd4d107-daca-49a5-a3d3-15de6737394a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:07.075146 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.075025 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fsfq\" (UniqueName: \"kubernetes.io/projected/dfd4d107-daca-49a5-a3d3-15de6737394a-kube-api-access-4fsfq\") pod \"payload-pre-processing-7677b774bb-6z9kd\" (UID: \"dfd4d107-daca-49a5-a3d3-15de6737394a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:07.176257 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.176220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd4d107-daca-49a5-a3d3-15de6737394a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6z9kd\" (UID: \"dfd4d107-daca-49a5-a3d3-15de6737394a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:07.176437 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.176267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fsfq\" (UniqueName: \"kubernetes.io/projected/dfd4d107-daca-49a5-a3d3-15de6737394a-kube-api-access-4fsfq\") pod \"payload-pre-processing-7677b774bb-6z9kd\" (UID: \"dfd4d107-daca-49a5-a3d3-15de6737394a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:07.176972 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.176948 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd4d107-daca-49a5-a3d3-15de6737394a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6z9kd\" (UID: \"dfd4d107-daca-49a5-a3d3-15de6737394a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:07.184731 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.184701 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fsfq\" (UniqueName: \"kubernetes.io/projected/dfd4d107-daca-49a5-a3d3-15de6737394a-kube-api-access-4fsfq\") pod \"payload-pre-processing-7677b774bb-6z9kd\" (UID: \"dfd4d107-daca-49a5-a3d3-15de6737394a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:07.350847 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.350756 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:07.487053 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.487023 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6z9kd"] Jul 17 22:18:07.488708 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:18:07.488682 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd4d107_daca_49a5_a3d3_15de6737394a.slice/crio-afd89b204365b04c50143706caa6dbee3e5d81ff03c3e99a57764ebac41b69b7 WatchSource:0}: Error finding container afd89b204365b04c50143706caa6dbee3e5d81ff03c3e99a57764ebac41b69b7: Status 404 returned error can't find the container with id afd89b204365b04c50143706caa6dbee3e5d81ff03c3e99a57764ebac41b69b7 Jul 17 22:18:07.893808 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.893762 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" event={"ID":"a29b3855-915c-4df6-a46d-bf60f11a0071","Type":"ContainerStarted","Data":"b68592267697ec2017f9093be0635fe43e0c33db0a1fdef45c2165125402e694"} Jul 17 22:18:07.895149 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:07.895121 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" event={"ID":"dfd4d107-daca-49a5-a3d3-15de6737394a","Type":"ContainerStarted","Data":"afd89b204365b04c50143706caa6dbee3e5d81ff03c3e99a57764ebac41b69b7"} Jul 17 22:18:09.906543 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:09.906505 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" event={"ID":"a29b3855-915c-4df6-a46d-bf60f11a0071","Type":"ContainerStarted","Data":"8d331c3f860aef1c2b0def206b767ca1ab72eb1438e0abeb1f38fa93f197dabd"} Jul 17 22:18:09.907010 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:09.906631 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:09.908227 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:09.908197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" event={"ID":"dfd4d107-daca-49a5-a3d3-15de6737394a","Type":"ContainerStarted","Data":"3d98964afe95abcd1b077400c7d6786bf667680cc84ffb8aaad91eb6f43dec5a"} Jul 17 22:18:09.908378 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:09.908271 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:09.923724 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:09.923665 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" podStartSLOduration=1.8770922620000001 podStartE2EDuration="3.923649275s" totalImagesPullingTime="2.046557013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:18:09.923248215 +0000 UTC m=+562.081436921" watchObservedRunningTime="2026-07-17 22:18:09.923649275 +0000 UTC m=+562.081837978" Jul 17 22:18:09.938350 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:09.938283 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" podStartSLOduration=1.280287261 podStartE2EDuration="2.938265823s" totalImagesPullingTime="1.657978562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:18:09.937249779 +0000 UTC m=+562.095438506" watchObservedRunningTime="2026-07-17 22:18:09.938265823 +0000 UTC m=+562.096454531" Jul 17 22:18:15.918966 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:15.918930 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5dbd8cdb89-6q4k5" Jul 17 22:18:17.583689 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:17.583657 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:17.683994 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:17.683958 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:20.915272 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:20.915239 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-6z9kd" Jul 17 22:18:23.112893 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.112858 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc"] Jul 17 22:18:23.116481 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.116461 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.120401 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.120376 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 22:18:23.120533 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.120410 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gph8k\"" Jul 17 22:18:23.120533 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.120411 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 22:18:23.120533 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.120411 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 17 22:18:23.126902 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.126881 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc"] Jul 17 22:18:23.143826 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.143789 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:23.217233 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.217194 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.217418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.217241 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb75c\" (UniqueName: \"kubernetes.io/projected/b78ae1b0-813a-4a29-9ab0-7627daa35d26-kube-api-access-nb75c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.217418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.217270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.217418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.217344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.217418 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.217401 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b78ae1b0-813a-4a29-9ab0-7627daa35d26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.217613 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.217438 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.318632 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.318589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.318825 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.318641 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb75c\" (UniqueName: \"kubernetes.io/projected/b78ae1b0-813a-4a29-9ab0-7627daa35d26-kube-api-access-nb75c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.318825 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.318673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.318825 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.318697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.318825 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.318740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b78ae1b0-813a-4a29-9ab0-7627daa35d26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.318825 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.318773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.319130 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.319101 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.319192 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.319133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.319314 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.319293 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.321249 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.321218 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b78ae1b0-813a-4a29-9ab0-7627daa35d26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.321375 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.321267 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b78ae1b0-813a-4a29-9ab0-7627daa35d26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.327828 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.327804 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb75c\" (UniqueName: \"kubernetes.io/projected/b78ae1b0-813a-4a29-9ab0-7627daa35d26-kube-api-access-nb75c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc\" (UID: \"b78ae1b0-813a-4a29-9ab0-7627daa35d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.427477 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.427388 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:23.559683 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.559655 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc"] Jul 17 22:18:23.561284 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:18:23.561257 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78ae1b0_813a_4a29_9ab0_7627daa35d26.slice/crio-29586930eb6aea04a1b6f23c8d48a241b9ab7b8e9e42797b024fc365759975a2 WatchSource:0}: Error finding container 29586930eb6aea04a1b6f23c8d48a241b9ab7b8e9e42797b024fc365759975a2: Status 404 returned error can't find the container with id 29586930eb6aea04a1b6f23c8d48a241b9ab7b8e9e42797b024fc365759975a2 Jul 17 22:18:23.981087 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:23.981039 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" event={"ID":"b78ae1b0-813a-4a29-9ab0-7627daa35d26","Type":"ContainerStarted","Data":"29586930eb6aea04a1b6f23c8d48a241b9ab7b8e9e42797b024fc365759975a2"} Jul 17 22:18:24.988652 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:24.988603 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" event={"ID":"b78ae1b0-813a-4a29-9ab0-7627daa35d26","Type":"ContainerStarted","Data":"a5c2f124de957f85359ade884758e06e0a9273e772278a405fa61b0c1884d490"} Jul 17 22:18:25.007118 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:25.007055 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" podStartSLOduration=0.895279434 podStartE2EDuration="2.00703994s" totalImagesPullingTime="1.111760506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:18:25.005077324 +0000 UTC m=+577.163266041" watchObservedRunningTime="2026-07-17 22:18:25.00703994 +0000 UTC m=+577.165228643" Jul 17 22:18:33.294771 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:33.294733 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:33.428389 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:33.428325 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:33.428579 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:33.428427 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:33.440960 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:33.440927 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:34.043913 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:34.043885 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc" Jul 17 22:18:44.021956 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.021919 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk"] Jul 17 22:18:44.025168 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.025146 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.027893 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.027863 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 17 22:18:44.037796 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.037753 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk"] Jul 17 22:18:44.066490 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.066456 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:44.202935 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.202891 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.202935 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.202938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e734c85-09b5-4825-935e-439fb6122287-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.203163 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.203006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.203163 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.203030 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.203163 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.203056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.203163 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.203085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4w4s\" (UniqueName: \"kubernetes.io/projected/1e734c85-09b5-4825-935e-439fb6122287-kube-api-access-b4w4s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.304460 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.304369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.304460 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.304419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.304693 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.304537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.304693 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.304581 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w4s\" (UniqueName: \"kubernetes.io/projected/1e734c85-09b5-4825-935e-439fb6122287-kube-api-access-b4w4s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.304693 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.304661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.304693 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.304683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e734c85-09b5-4825-935e-439fb6122287-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.304906 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.304805 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.304906 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.304814 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.305037 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.305013 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.306839 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.306817 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e734c85-09b5-4825-935e-439fb6122287-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.307138 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.307118 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e734c85-09b5-4825-935e-439fb6122287-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.313371 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.313323 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4w4s\" (UniqueName: \"kubernetes.io/projected/1e734c85-09b5-4825-935e-439fb6122287-kube-api-access-b4w4s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wfsvk\" (UID: \"1e734c85-09b5-4825-935e-439fb6122287\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.337800 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.337770 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:44.472730 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:44.472700 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk"] Jul 17 22:18:44.474268 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:18:44.474230 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e734c85_09b5_4825_935e_439fb6122287.slice/crio-fb1c09733745511450face542bb13887db4eb9774f412ea51bf0a6f0feeea00a WatchSource:0}: Error finding container fb1c09733745511450face542bb13887db4eb9774f412ea51bf0a6f0feeea00a: Status 404 returned error can't find the container with id fb1c09733745511450face542bb13887db4eb9774f412ea51bf0a6f0feeea00a Jul 17 22:18:45.095849 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:45.095815 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" event={"ID":"1e734c85-09b5-4825-935e-439fb6122287","Type":"ContainerStarted","Data":"2b039187527722b99662ce551c68d36d4d68992ec025e6d0e57c86eb02325e30"} Jul 17 22:18:45.096255 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:45.095868 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" event={"ID":"1e734c85-09b5-4825-935e-439fb6122287","Type":"ContainerStarted","Data":"fb1c09733745511450face542bb13887db4eb9774f412ea51bf0a6f0feeea00a"} Jul 17 22:18:45.115740 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:45.115686 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" podStartSLOduration=0.948313028 podStartE2EDuration="1.115668071s" totalImagesPullingTime="167.355043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:18:45.114467919 +0000 UTC m=+597.272656624" watchObservedRunningTime="2026-07-17 22:18:45.115668071 +0000 UTC m=+597.273856814" Jul 17 22:18:47.349136 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:47.349095 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:48.289562 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:48.289529 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/1.log" Jul 17 22:18:48.290375 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:48.290348 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/1.log" Jul 17 22:18:52.241608 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:52.241557 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:18:54.338549 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:54.338495 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:54.338969 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:54.338593 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:54.351195 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:54.351165 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:18:55.158433 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:18:55.158405 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wfsvk" Jul 17 22:19:00.226922 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.226890 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl"] Jul 17 22:19:00.231872 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.231854 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.234541 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.234520 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 17 22:19:00.239369 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.239323 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl"] Jul 17 22:19:00.249908 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.249879 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:19:00.340669 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.340627 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4dn\" (UniqueName: \"kubernetes.io/projected/445b14a2-ad45-4c7e-8c4d-f75214c3822c-kube-api-access-qc4dn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.340862 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.340684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.340862 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.340775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.341015 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.340989 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.341093 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.341078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.341131 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.341102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/445b14a2-ad45-4c7e-8c4d-f75214c3822c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442353 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4dn\" (UniqueName: \"kubernetes.io/projected/445b14a2-ad45-4c7e-8c4d-f75214c3822c-kube-api-access-qc4dn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442353 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442569 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442569 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442569 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442569 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442514 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/445b14a2-ad45-4c7e-8c4d-f75214c3822c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442873 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442844 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442936 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442869 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.442991 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.442965 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.444779 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.444758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/445b14a2-ad45-4c7e-8c4d-f75214c3822c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.444948 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.444932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/445b14a2-ad45-4c7e-8c4d-f75214c3822c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.450218 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.450193 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4dn\" (UniqueName: \"kubernetes.io/projected/445b14a2-ad45-4c7e-8c4d-f75214c3822c-kube-api-access-qc4dn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5f2bl\" (UID: \"445b14a2-ad45-4c7e-8c4d-f75214c3822c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.544284 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.544190 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:00.681513 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:00.681483 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl"] Jul 17 22:19:00.683505 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:19:00.683476 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445b14a2_ad45_4c7e_8c4d_f75214c3822c.slice/crio-259e9dad519e1464fa6cc8e13386f6efbe0f7d1e05a020c5f5086f6ad8c8f62a WatchSource:0}: Error finding container 259e9dad519e1464fa6cc8e13386f6efbe0f7d1e05a020c5f5086f6ad8c8f62a: Status 404 returned error can't find the container with id 259e9dad519e1464fa6cc8e13386f6efbe0f7d1e05a020c5f5086f6ad8c8f62a Jul 17 22:19:01.179609 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:01.179522 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" event={"ID":"445b14a2-ad45-4c7e-8c4d-f75214c3822c","Type":"ContainerStarted","Data":"101b25ce93229189c931b787b1f258b04b62622c1f22f4028d5786fd4be40bc1"} Jul 17 22:19:01.179609 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:01.179587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" event={"ID":"445b14a2-ad45-4c7e-8c4d-f75214c3822c","Type":"ContainerStarted","Data":"259e9dad519e1464fa6cc8e13386f6efbe0f7d1e05a020c5f5086f6ad8c8f62a"} Jul 17 22:19:01.197888 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:01.197825 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" podStartSLOduration=1.0361005620000001 podStartE2EDuration="1.197808554s" totalImagesPullingTime="161.707992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 22:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:19:01.19616622 +0000 UTC m=+613.354354925" watchObservedRunningTime="2026-07-17 22:19:01.197808554 +0000 UTC m=+613.355997258" Jul 17 22:19:10.544602 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:10.544566 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:10.545023 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:10.544632 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:10.557042 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:10.557012 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:11.240198 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:11.240160 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5f2bl" Jul 17 22:19:11.437021 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:19:11.436986 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:20:08.113571 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:08.113529 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:20:08.208486 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:08.208445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:20:09.209191 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:09.209145 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:20:09.307943 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:09.307904 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:20:53.572046 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:53.571966 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d7c667b-zsd75_2bc93797-79ae-4e02-9ace-5bcc20a1242b/manager/0.log" Jul 17 22:20:54.152322 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:54.152294 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c584869-ms5dd_d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3/copy-manifests/0.log" Jul 17 22:20:54.163637 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:54.163610 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c584869-ms5dd_d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3/manager/0.log" Jul 17 22:20:54.507580 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:54.507549 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5dbd8cdb89-6q4k5_a29b3855-915c-4df6-a46d-bf60f11a0071/maas-api/0.log" Jul 17 22:20:54.620630 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:54.620597 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-n9qw4_7819c5c7-bf71-4add-af37-3eaee6f52abf/postgres/0.log" Jul 17 22:20:55.386604 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.386579 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q_3caf17c3-a2cf-4283-8082-1d6728c51818/extract/0.log" Jul 17 22:20:55.392100 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.392079 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q_3caf17c3-a2cf-4283-8082-1d6728c51818/util/0.log" Jul 17 22:20:55.399659 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.399636 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q_3caf17c3-a2cf-4283-8082-1d6728c51818/pull/0.log" Jul 17 22:20:55.510221 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.510190 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp_d6ba17d4-c384-4600-b365-c5e5dcddeb00/util/0.log" Jul 17 22:20:55.515523 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.515498 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp_d6ba17d4-c384-4600-b365-c5e5dcddeb00/pull/0.log" Jul 17 22:20:55.520678 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.520662 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp_d6ba17d4-c384-4600-b365-c5e5dcddeb00/extract/0.log" Jul 17 22:20:55.629588 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.629558 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5_c0aac44a-2944-4b9e-ad1e-2c4beebd9865/util/0.log" Jul 17 22:20:55.635856 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.635835 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5_c0aac44a-2944-4b9e-ad1e-2c4beebd9865/pull/0.log" Jul 17 22:20:55.642593 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.642535 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5_c0aac44a-2944-4b9e-ad1e-2c4beebd9865/extract/0.log" Jul 17 22:20:55.750493 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.750465 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx_54b2e4ec-5d56-401f-b637-8ac6bab887a8/util/0.log" Jul 17 22:20:55.757224 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.757204 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx_54b2e4ec-5d56-401f-b637-8ac6bab887a8/pull/0.log" Jul 17 22:20:55.763693 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:55.763673 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx_54b2e4ec-5d56-401f-b637-8ac6bab887a8/extract/0.log" Jul 17 22:20:57.176165 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:57.176131 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6pj8h_8bea1e31-4ac4-4115-918a-6ab67e6085e9/discovery/0.log" Jul 17 22:20:57.626568 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:57.626535 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6z9kd_dfd4d107-daca-49a5-a3d3-15de6737394a/payload-pre-processing/0.log" Jul 17 22:20:57.848360 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:57.848306 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64fd77f47d-9w6vw_d2a59372-e2fc-4941-8504-f5c3ae176332/router/0.log" Jul 17 22:20:58.195174 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:58.195143 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-m5wtc_b78ae1b0-813a-4a29-9ab0-7627daa35d26/main/0.log" Jul 17 22:20:58.301824 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:58.301795 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wfsvk_1e734c85-09b5-4825-935e-439fb6122287/main/0.log" Jul 17 22:20:58.632438 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:20:58.632361 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5f2bl_445b14a2-ad45-4c7e-8c4d-f75214c3822c/main/0.log" Jul 17 22:21:04.424541 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:04.424506 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:21:04.489215 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:04.489187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:21:07.491609 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:07.491576 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7wlr8_f7906899-be0c-4a35-bfdb-2aff51baf928/global-pull-secret-syncer/0.log" Jul 17 22:21:07.615476 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:07.615448 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" Jul 17 22:21:07.726411 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:07.726377 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-78.ec2.internal_8bc2a20e77f7595ccd462b1cae835411/haproxy/0.log" Jul 17 22:21:12.577584 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.577545 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q_3caf17c3-a2cf-4283-8082-1d6728c51818/extract/0.log" Jul 17 22:21:12.600402 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.600376 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q_3caf17c3-a2cf-4283-8082-1d6728c51818/util/0.log" Jul 17 22:21:12.622724 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.622692 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596wf8q_3caf17c3-a2cf-4283-8082-1d6728c51818/pull/0.log" Jul 17 22:21:12.681981 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.681952 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp_d6ba17d4-c384-4600-b365-c5e5dcddeb00/extract/0.log" Jul 17 22:21:12.710410 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.710375 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp_d6ba17d4-c384-4600-b365-c5e5dcddeb00/util/0.log" Jul 17 22:21:12.737564 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.737531 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xxspp_d6ba17d4-c384-4600-b365-c5e5dcddeb00/pull/0.log" Jul 17 22:21:12.765484 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.765454 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5_c0aac44a-2944-4b9e-ad1e-2c4beebd9865/extract/0.log" Jul 17 22:21:12.785467 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.785442 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5_c0aac44a-2944-4b9e-ad1e-2c4beebd9865/util/0.log" Jul 17 22:21:12.804594 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.804566 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nlwg5_c0aac44a-2944-4b9e-ad1e-2c4beebd9865/pull/0.log" Jul 17 22:21:12.829396 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.829289 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx_54b2e4ec-5d56-401f-b637-8ac6bab887a8/extract/0.log" Jul 17 22:21:12.850529 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.850505 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx_54b2e4ec-5d56-401f-b637-8ac6bab887a8/util/0.log" Jul 17 22:21:12.875062 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:12.875009 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1l4fsx_54b2e4ec-5d56-401f-b637-8ac6bab887a8/pull/0.log" Jul 17 22:21:14.800791 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:14.800763 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-8mjr5_115aa6f9-ed4e-4851-85c4-295a61a232ff/cluster-monitoring-operator/0.log" Jul 17 22:21:15.040611 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:15.040581 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5fgw_c4723a6b-1ba6-4cf4-83c1-11f245d3811d/node-exporter/0.log" Jul 17 22:21:15.070867 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:15.070770 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5fgw_c4723a6b-1ba6-4cf4-83c1-11f245d3811d/kube-rbac-proxy/0.log" Jul 17 22:21:15.091948 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:15.091925 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5fgw_c4723a6b-1ba6-4cf4-83c1-11f245d3811d/init-textfile/0.log" Jul 17 22:21:17.502986 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.502939 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh"] Jul 17 22:21:17.506591 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.506565 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.509390 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.509364 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hxbcd\"/\"kube-root-ca.crt\"" Jul 17 22:21:17.509556 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.509517 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hxbcd\"/\"openshift-service-ca.crt\"" Jul 17 22:21:17.509627 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.509582 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hxbcd\"/\"default-dockercfg-qfszw\"" Jul 17 22:21:17.516364 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.516326 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh"] Jul 17 22:21:17.596504 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.596476 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/1.log" Jul 17 22:21:17.602531 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.602507 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-qdjzw_0d083fe3-08ed-469c-beb3-31f10c742433/console-operator/2.log" Jul 17 22:21:17.605802 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.605771 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-sys\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.605945 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.605819 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnhfr\" (UniqueName: \"kubernetes.io/projected/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-kube-api-access-mnhfr\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.605945 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.605907 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-proc\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.606067 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.605962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-podres\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.606067 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.605993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-lib-modules\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.706575 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-proc\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.706770 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-podres\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.706770 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706639 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-proc\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.706770 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-lib-modules\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.706770 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-sys\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.706770 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706764 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-podres\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.706770 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706768 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-lib-modules\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.707013 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnhfr\" (UniqueName: \"kubernetes.io/projected/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-kube-api-access-mnhfr\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.707013 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.706842 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-sys\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.715199 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.715166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnhfr\" (UniqueName: \"kubernetes.io/projected/b75c8f4d-6bd5-439e-b54f-30c507b5ccde-kube-api-access-mnhfr\") pod \"perf-node-gather-daemonset-j9fjh\" (UID: \"b75c8f4d-6bd5-439e-b54f-30c507b5ccde\") " pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.817278 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.817177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:17.955489 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:17.955462 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh"] Jul 17 22:21:17.957473 ip-10-0-142-78 kubenswrapper[2556]: W0717 22:21:17.957443 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb75c8f4d_6bd5_439e_b54f_30c507b5ccde.slice/crio-8f92e0dd73bca061a1a3b528d810559839e0c51ee982736c9f6d150f7b64b19e WatchSource:0}: Error finding container 8f92e0dd73bca061a1a3b528d810559839e0c51ee982736c9f6d150f7b64b19e: Status 404 returned error can't find the container with id 8f92e0dd73bca061a1a3b528d810559839e0c51ee982736c9f6d150f7b64b19e Jul 17 22:21:18.119870 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:18.119791 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f7f69bb4c-bd45w_98e9d2df-70f1-4934-8bd9-6dc61a623cdf/console/0.log" Jul 17 22:21:18.146032 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:18.146005 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-q9656_6f8ec9fd-9b9e-4fee-95cd-93f7cd2fdbc4/download-server/0.log" Jul 17 22:21:18.709722 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:18.709691 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-g7d5m_8e4b1a65-ce08-4206-938a-7fa003385ce1/volume-data-source-validator/0.log" Jul 17 22:21:18.880996 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:18.880958 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" event={"ID":"b75c8f4d-6bd5-439e-b54f-30c507b5ccde","Type":"ContainerStarted","Data":"fdecdcde391afaff9aa401164975a5bf3f66a88173d9d51008c0c8681308b15c"} Jul 17 22:21:18.881209 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:18.881024 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:18.881209 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:18.881043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" event={"ID":"b75c8f4d-6bd5-439e-b54f-30c507b5ccde","Type":"ContainerStarted","Data":"8f92e0dd73bca061a1a3b528d810559839e0c51ee982736c9f6d150f7b64b19e"} Jul 17 22:21:18.899131 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:18.899077 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" podStartSLOduration=1.8990616120000001 podStartE2EDuration="1.899061612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 22:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 22:21:18.896566711 +0000 UTC m=+751.054755418" watchObservedRunningTime="2026-07-17 22:21:18.899061612 +0000 UTC m=+751.057250316" Jul 17 22:21:19.681661 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:19.681632 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46h6v_8d86bd4a-ec07-4798-aaed-7608028ee9d5/dns/0.log" Jul 17 22:21:19.706266 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:19.706240 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46h6v_8d86bd4a-ec07-4798-aaed-7608028ee9d5/kube-rbac-proxy/0.log" Jul 17 22:21:19.874020 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:19.873987 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k2pss_26ca3f5f-aaba-4e34-ae88-97245f318cf4/dns-node-resolver/0.log" Jul 17 22:21:20.401875 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:20.401847 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4zdhk_0e9a1ee0-6b84-460c-97a9-7604811a6a6a/node-ca/0.log" Jul 17 22:21:21.372893 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:21.372862 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6pj8h_8bea1e31-4ac4-4115-918a-6ab67e6085e9/discovery/0.log" Jul 17 22:21:21.463838 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:21.463807 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6z9kd_dfd4d107-daca-49a5-a3d3-15de6737394a/payload-pre-processing/0.log" Jul 17 22:21:21.510954 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:21.510929 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64fd77f47d-9w6vw_d2a59372-e2fc-4941-8504-f5c3ae176332/router/0.log" Jul 17 22:21:22.149092 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:22.149061 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tdl2l_48da6edc-ec29-45af-b684-f3ae08d9d1e0/serve-healthcheck-canary/0.log" Jul 17 22:21:22.580286 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:22.580245 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-t4vf2_b36c8f1e-c34e-4d9a-8f95-7b83e8390082/insights-operator/0.log" Jul 17 22:21:22.580720 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:22.580437 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-t4vf2_b36c8f1e-c34e-4d9a-8f95-7b83e8390082/insights-operator/1.log" Jul 17 22:21:22.739012 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:22.738982 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9cwt7_d135016a-fb35-4b02-8cf6-e99c32b83ce9/kube-rbac-proxy/0.log" Jul 17 22:21:22.758577 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:22.758553 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9cwt7_d135016a-fb35-4b02-8cf6-e99c32b83ce9/exporter/0.log" Jul 17 22:21:22.778940 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:22.778913 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9cwt7_d135016a-fb35-4b02-8cf6-e99c32b83ce9/extractor/0.log" Jul 17 22:21:24.883740 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:24.883705 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d7c667b-zsd75_2bc93797-79ae-4e02-9ace-5bcc20a1242b/manager/0.log" Jul 17 22:21:24.895322 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:24.895296 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hxbcd/perf-node-gather-daemonset-j9fjh" Jul 17 22:21:25.091405 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:25.091369 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c584869-ms5dd_d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3/manager/0.log" Jul 17 22:21:25.106986 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:25.106956 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c584869-ms5dd_d1572b5a-f6c6-42dd-b9eb-30aa6ff6a8f3/copy-manifests/0.log" Jul 17 22:21:26.330050 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:26.329971 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b44947954-nsffk_c7c25b6a-50b0-4cbd-919a-6a0a38f36122/manager/0.log" Jul 17 22:21:27.377756 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:27.377720 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6pj8h_8bea1e31-4ac4-4115-918a-6ab67e6085e9/discovery/0.log" Jul 17 22:21:27.455676 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:27.455631 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6z9kd_dfd4d107-daca-49a5-a3d3-15de6737394a/payload-pre-processing/0.log" Jul 17 22:21:27.487515 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:27.487485 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64fd77f47d-9w6vw_d2a59372-e2fc-4941-8504-f5c3ae176332/router/0.log" Jul 17 22:21:28.538887 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:28.538808 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6pj8h_8bea1e31-4ac4-4115-918a-6ab67e6085e9/discovery/0.log" Jul 17 22:21:28.609850 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:28.609817 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6z9kd_dfd4d107-daca-49a5-a3d3-15de6737394a/payload-pre-processing/0.log" Jul 17 22:21:28.647233 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:28.647206 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64fd77f47d-9w6vw_d2a59372-e2fc-4941-8504-f5c3ae176332/router/0.log" Jul 17 22:21:28.666901 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:28.666871 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n29f_884c3385-de1b-463b-b05f-26d5a7cd934f/konnectivity-agent/0.log" limit=1024 Jul 17 22:21:31.802643 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:31.802611 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-fm2jc_82a8fba8-65a4-4b5a-9fc2-8af1587fe43c/kube-storage-version-migrator-operator/1.log" Jul 17 22:21:31.803445 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:31.803424 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-fm2jc_82a8fba8-65a4-4b5a-9fc2-8af1587fe43c/kube-storage-version-migrator-operator/0.log" Jul 17 22:21:32.969745 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:32.969715 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt4vl_d76f636b-dc83-40aa-9bd3-62b7b7cfe85c/kube-multus-additional-cni-plugins/0.log" Jul 17 22:21:32.990952 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:32.990910 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt4vl_d76f636b-dc83-40aa-9bd3-62b7b7cfe85c/egress-router-binary-copy/0.log" Jul 17 22:21:33.011804 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:33.011774 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt4vl_d76f636b-dc83-40aa-9bd3-62b7b7cfe85c/cni-plugins/0.log" Jul 17 22:21:33.032191 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:33.032119 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt4vl_d76f636b-dc83-40aa-9bd3-62b7b7cfe85c/bond-cni-plugin/0.log" Jul 17 22:21:33.051527 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:33.051501 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt4vl_d76f636b-dc83-40aa-9bd3-62b7b7cfe85c/routeoverride-cni/0.log" Jul 17 22:21:33.073215 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:33.073168 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt4vl_d76f636b-dc83-40aa-9bd3-62b7b7cfe85c/whereabouts-cni-bincopy/0.log" Jul 17 22:21:33.092220 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:33.092197 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt4vl_d76f636b-dc83-40aa-9bd3-62b7b7cfe85c/whereabouts-cni/0.log" Jul 17 22:21:33.277393 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:33.277355 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kwz6x_9a09ae06-4826-4805-93d2-c7cbbb06681b/kube-multus/0.log" Jul 17 22:21:33.394160 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:33.394132 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p7khv_39c40759-5ff2-450f-8541-91ae0a4fa8b5/network-metrics-daemon/0.log" Jul 17 22:21:33.411991 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:33.411964 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p7khv_39c40759-5ff2-450f-8541-91ae0a4fa8b5/kube-rbac-proxy/0.log" Jul 17 22:21:34.225157 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:34.225127 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwcjd_2ecafaba-a637-4223-9f95-1bef2dd6449b/ovn-controller/0.log" Jul 17 22:21:34.241446 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:34.241415 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwcjd_2ecafaba-a637-4223-9f95-1bef2dd6449b/ovn-acl-logging/0.log" Jul 17 22:21:34.262987 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:34.262952 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwcjd_2ecafaba-a637-4223-9f95-1bef2dd6449b/kube-rbac-proxy-node/0.log" Jul 17 22:21:34.284276 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:34.284253 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwcjd_2ecafaba-a637-4223-9f95-1bef2dd6449b/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 22:21:34.303213 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:34.303185 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwcjd_2ecafaba-a637-4223-9f95-1bef2dd6449b/northd/0.log" Jul 17 22:21:34.322021 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:34.321997 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwcjd_2ecafaba-a637-4223-9f95-1bef2dd6449b/nbdb/0.log" Jul 17 22:21:34.341628 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:34.341598 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwcjd_2ecafaba-a637-4223-9f95-1bef2dd6449b/sbdb/0.log" Jul 17 22:21:34.382018 ip-10-0-142-78 kubenswrapper[2556]: I0717 22:21:34.381964 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cwcjd_2ecafaba-a637-4223-9f95-1bef2dd6449b/ovnkube-controller/0.log"